Oddbean new post about | logout
▲ ▼
Doog | 8 months ago (raw) | root | parent | reply | flag 
 What has been the biggest challenge in getting the LLM up and running?
▲ ▼
jb55 | 8 months ago (raw) | root | parent | reply | flag +1 
 Performance has always been the concern, and the fact it needs a 5gb download
▲ ▼
shawn | 8 months ago (raw) | root | parent | reply | flag +1 
 Might also be worth at look at what was done for this app. I bought it; pretty impressive even with the ‘Tiny’ model. 

https://apps.apple.com/us/app/offline-chat-private-ai/id6474077941 https://i.nostr.build/XWLW.jpg
▲ ▼
jb55 | 8 months ago (raw) | root | parent | reply | flag +1 
 Awesome