Oddbean new post about | logout
▲ ▼
elsat | 10 months ago (raw) | root | parent | reply | flag 
 @tyiu looked a while back, and we were disappointed not to find apple translation API available to devs
▲ ▼
tyiu | 10 months ago (raw) | root | parent | reply | flag 
 MLC LLM has an iOS implementation of an offline capable chat app using LLMs. However, it’s several gigabytes large and performance isn’t great on my iPhone (faster on my MacBook). Hoping for better performance and more direct translation APIs as a library as folks develop in this space more.

https://apps.apple.com/us/app/mlc-chat/id6448482937

https://github.com/mlc-ai/mlc-llm