Does Size Matter for Natural Language Text Generation?

OpenAI GPT-3 has 175 Billion parameters. Microsoft has leapfrogged GPT-3 with Turing-NLG with 1,000 Billion parameters.

Photo by Bernard Hermant on Unsplash

Sorry. Wrong.

Admittedly, I fell for it. I was not careful reading technology breaking news and announcements last week.

Microsoft did not announce that they trained a Natural Language Transformer…