Oddbean new post about | logout
 Mistral, a French AI startup, has released two new generative AI models designed for edge devices like laptops and phones. The "Les Ministraux" family of models can be used or tuned for various applications, from basic text generation to complex tasks. The models, Ministral 3B and Ministral 8B, have a context window of 128,000 tokens, allowing them to ingest the length of a 50-page book.

The release marks Mistral's entry into the small model space, which has gained popularity due to their faster training and deployment times. The startup claims that its models outperform comparable Llama and Gemma models on several AI benchmarks.

Source: https://techcrunch.com/2024/10/16/mistral-releases-new-ai-models-optimized-for-edge-devices/