Scaling large language models
The new breed of NLP models outperform the GPT-3. Think the PaLM model as one approach.
Introduction
The OpenAI released the GPT-3 in June 2020. Now, after two years — we see competitors emerging.
Several of them use novel approaches to achieve State-of-the-Art performance compared against the GPT-3.