Mixture-of-Agents Beats ChatGPT-4o

Collaboration is Intelligence

Ignacio de Gregorio
7 min readJun 21, 2024
Generated by author using GPT-4o

If you’ve followed me for a while now, you will have realized how excited I am about long-inference models. I believe — and academia does, too — that they are the next frontier for AI in terms of reasoning capabilities.

Now, a group of researchers at the start-up Together.ai (a company that serves LLMs) has published a paper on Mixture-of-Agents (MoA), how different LLMs can combine to produce much better results in complex tasks.

And by better results I mean beating GPT-4o in highly popular benchmarks while using a set of very inferior models.

But how on Earth is that possible? That’s the power of long inference. Let’s dive in.

You are probably sick of AI newsletters talking about how this or that **just** happened. These newsletters abound because coarsely talking about events and things that already took place is easy, but the value provided is limited, and the hype exaggerated.

However, newsletters talking about what will happen are a rare sight. If you’re into easy-to-understand insights looking into the future of AI before anyone else does, TheTechOasis newsletter might be perfect for you.

🏝️🏝️ Subscribe today below:

--

--