Code Rewrite By Developers Results in Grok-2 Getting A Speed Bump In Just Three Days.
Elon Musk’s Grok 2 made waves when it was released last week to the public and its available through an $8 USD monthly subscription on X (formerly twitter).
Grok-2 comes in two versions, Grok-2 and Grok-2 mini. Grok2 mini is specifically designed to be less powerful but faster. Speed of both versions has now been increased. They can now analyze information and give output much faster after two developers at xAI completely rewrote the code stack in the last three days.
As xAI developer Igor Babuschkin posted this afternoon on the social network X under his handle @ibab:
“Grok 2 mini is now 2x faster than it was yesterday. In the last three days @lm_zheng and @MalekiSaeed rewrote our inference stack from scratch using SGLang. This has also allowed us to serve the big Grok 2 model, which requires multi-host inference, at a reasonable speed. Both models didn’t just get faster, but also slightly more accurate. Stay tuned for further speed improvements!”
