Orca Emerges from the Depths: An Open-Source Threat to ChatGPT
Redefining the Open-Source Landscape
Everyone loves the idea of community-built AI chatbots that match or exceed the performance of privately-owned models like ChatGPT.
The thought is almost romantic; the power of the people defeating the tech giants back at Silicon Valley.
However, as leaderboards like Chatbot Arena prove time and time again, the billions-backed chatbots remain undisputed kings.
But now Microsoft, unexpectedly, has presented Orca, an open-source much-smaller-than-ChatGPT model that, using an innovative training method, is the first model ever to look in the eyes of the private models and say:
“We’re in the same league now”.
And all this despite being dozens of times (most probably hundreds in the case of GPT-4) smaller than the models it’s competing against.
Incredibly, Orca even defeats them in some cases, while completely obliterating what was until now considered the best open-source model, Vicuna.
But what makes Orca so damn good and special?
If you want to feel up-to-date with the frenetic world of AI while also feeling…
