Everything About MISTRAL’S Mixtral-8x7B: The Best Open LLM

Maya Akim
6 min readDec 13, 2023
Mistral’s blog that announced the latest model

Every December, machine learning experts gather at the annual NeurIPS conference to discuss the latest and greatest achievements in ML. This influential event makes late November and early December an ideal time for AI startups to launch their products.

ChatGPT revolutionized the AI landscape with its launch on November 30, 2022. Following this, Google introduced its controversial model, Gemini, on December 6th 2023. Just a few days later, Mistral announced their latest model. They shared a torrent magnet link on Twitter, a genius marketing strategy that made the team very popular with the community.

Best Open Source Model So Far?

When it comes to performance, Mixtral seemingly matches or surpasses GPT-3.5 and Llama 2 70B on most benchmarks, while offering 6X faster inference compared to Llama 2.

Source: Mistral’s blog

Its notable features…

--

--

Maya Akim

I'm curious about ml/ai and I like to share everything I learn