Oddbean new post about | logout
 📣NEW paper! Don’t believe the hype: bigger AI ≠ better AI. @SashaMTL, @GaelVaroquaux and me on how the race to bigger, and bigger AI has bad consequences and isn't necessary. 

1. Smaller AI models often perform better than big models in context

And 

2. obsession with bigness has severe collateral consequences, from climate costs, to concentrated power, to more surveillance, to the capture of AI research. 

All of this, and what we can do instead 👇

arxiv.org/abs/2409.14160

https://s3.eu-central-2.wasabisys.com/mastodonworld/media_attachments/files/113/197/086/235/242/904/original/35f70e3883458c9b.png 
 Dammit mastodon...
nostr:nevent1qqsx32lfak3qhyydcu7x65zjmck2tjyfzuthdqa96ghuqpkupcj2cfgpzamhxue69uhhyetvv9ujuurjd9kkzmpwdejhgtczyzjzxljzpndskv3369clapumet3h5tdh40e0z23n0wt4xdmp3savyqcyqqqqqqgqhauk8