Oddbean new post about | logout
▲ ▼
Amine | 1 months ago (raw) | root | parent | reply | flag 
 How can I run them locally on an iPhone ?
▲ ▼
BHN 🍁 | 1 months ago (raw) | root | parent | reply | flag +2 
 Download gguf quantizations of the models (q4 minimum) and use software like MLCchat or Layla.ai. I'm not sure what software is available on iPhone, personally.
▲ ▼
Amine | 1 months ago (raw) | root | parent | reply | flag +1 
 Thanks 💜🫂 MLC Chat is available on iOS