MLearning.ai
Published in

MLearning.ai

Language models need proper training

There is new king in the NLP models! The Chinchilla NLP model beats GPT-3 and Gopher by optimizing model size. The Chinchilla is trained less parameters and more tokens. Let’s familiarize with it!

Photo by Victor Freitas on Unsplash

Introduction

The GPT-3 was major breakthrough in 2020. It triggered wave of large NLP models. I imagined nobody to dare to replicate such costly effort. Yet many competing and…

--

--

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store