Language models need proper training

There is new king in the NLP models! The Chinchilla NLP model beats GPT-3 and Gopher by optimizing model size. The Chinchilla is trained less parameters and more tokens. Let’s familiarize with it!

Photo by Victor Freitas on Unsplash

Introduction

The GPT-3 was major breakthrough in 2020. It triggered wave of large NLP models. I imagined nobody to dare to replicate such costly effort. Yet many competing and…