Oddbean new post about | logout
▲ ▼
NotBiebs | 3 months ago (raw) | root | parent | reply | flag 
 my macbook is old and can barely run the primal web app. so i doubt it would be good enough to run anything. 😂
▲ ▼
feline | 3 months ago (raw) | root | parent | reply | flag 
 Depending on how old it is, the best thing to try now is to install ollama, try a small-ish model such as phi3-mini, and see if you like it
▲ ▼
NotBiebs | 3 months ago (raw) | root | parent | reply | flag 
 i want to use llama 3.1 with 405 billion params though 😂
▲ ▼
NotBiebs | 3 months ago (raw) | root | parent | reply | flag +1 
 actually, maybe the 70 billion param one would be fine 😂
▲ ▼
feline | 3 months ago (raw) | root | parent | reply | flag 
 Build a 3x 3090 machine. Keep us updated 😁