Does Size Matter for Natural Language Text Generation?
OpenAI GPT-3 has 175 Billion parameters. Microsoft has leapfrogged GPT-3 with Turing-NLG with 1,000 Billion parameters.
Admittedly, I fell for it. I was not careful reading technology breaking news and announcements last week.
Microsoft did not announce that they trained a Natural Language Transformer…