Oddbean new post about | logout
 Ever wonder how LLM quantization enables powerful models to run on more devices?

https://cognisys.io/blog/quantization-of-llms-a-leap-forward-in-efficiency-and-accessibility