Oddbean new post about | logout
▲ ▼
jb55 | 1 months ago (raw) | root | parent | reply | flag +3 
 > Shrek entropy sampler https://i.nostr.build/XTMmUeKPPRdDy2Vc.jpg
▲ ▼
iefan 🕊️ | 1 months ago (raw) | root | parent | reply | flag 
 I did some testing with multiple types of models, also with the Llama 1b model. I haven't seen the official benchmarks yet, but improvements are very noticeable even on very small models.

System prompts:
https://image.nostr.build/88bbf240175554b202f853ba6228453ab8c598494175634fe5ed247c4b927288.jpg
nostr:nevent1qqs0mr006vwv866frr6mzheqmmdhlflyv6yptmlvfz249esuzj87fhgpzdmhxue69uhhwmm59e6hg7r09ehkuef0qgsvdac80utfn4gvly4fv54la0l6cp0udpptnm3ezzyajkdc44w53lgrqsqqqqqpr2mdyd
▲ ▼
iefan 🕊️ | 1 months ago (raw) | root | parent | reply | flag +1 
 It's a very early development. Feel free to test it out firsthand. I'll share updates once official benchmarks become available. 
nostr:nevent1qqs2u86x8d05tkpjtmxc9jfq2rwqh99q4zau5gwfpsw853ahgcxe7mspzamhxue69uhhyetvv9ujuvrcvd5xzapwvdhk6tczyrr0wpmlz6va2r8e92t990ltl7kqtlrgg2u7uwgs38v4nw9dt4y06qcyqqqqqqgc3zyjv