nostr:npub1j46f9va5qdrmamcwmncew7g8mwekgma386dhws6k04fsnlkqpcpsj23gm7 nostr:npub1jkymmeeazh5r5e39rmpu9mgkyjswrrkw2pmv8e4z3qrt9e8nyzasr8nj9y 

People are running LLMs locally. You might be interested to look at 

https://python.langchain.com/docs/guides/local_llms

Useful Sensors (founded by some of the DeepMind folks) are working on specialised boxes - running OSS LLMs on low-cost, low-power hardware with strong data privacy. 

https://usefulsensors.com/

Founder/CEO Pete Warden recently wrote about the economics of it, framing it as an inevitable shift from training to inference:

https://petewarden.com/2023/09/10/why-nvidias-ai-supremacy-is-only-temporary/

#localLLM #LLM #UX 

h/t nostr:npub1yl37a83lkqwwzdd6qj7clagncs543pvs2uwkzjyzmzkgwhnu6dhq6ey6aq