From all this AI saga, all I want is a general-purpose open-source LLM that is efficient enough to run locally on a phone, > 10 tokens/sec and smart enough to handle basic tasks like answering questions and reading PDFs with contextual understanding.
No AGI, nothing, just a model, Light enough to run on a device locally, yet smart enough to handle essential tasks, that’s all I need, I'm a simple man.
I want that too, plus the possibility to talk to the LLM without having the voice data stored on some evil corp's servers. Voice opens up so many possibilities like truly learning new languages without having to relocate to a new country.
Oddbean new post about login | logout 