Open AIs Revolutionary New NLP Model GPT-3

Prashant Chamarty
The Startup
Published in
4 min readJul 19, 2020

--

We have recently heard that GPT-3, a Natural Language Processing(NLP) models have been made available by Open AI and is touted to be an invention bigger than blockchain. The extent of this transformation is such that this deep learning model can help things shown as sci-fi to become accessible to be implemented by college students.

Technically speaking GPT-3 is a highly adaptable algorithm that generates models but let’s not get bogged down by semantics.GPT-3 has been defined as:

task-agnostic Natural Language Processing Model that requires manual tuning.

So it can do specific tasks like text generation and qualitative queries with minimal user adjustment. Historically models have been either task agnostic or have required minimal tuning, but GPT-3 has both the properties and hence is quick to train and easy to tune.NLP is a branch of AI that deals with and enables the interaction between computers and humans using the natural language. The NLP model achieves this by reading, deciphering, understanding, and making sense of human words in the given context.

GPT-3 has been trained using half a trillion words (Common Crawl Dataset) and based on that has generated 175 Billion parameter model. Parameters are different rules that are set in different conditions by learning how language works. The…

--

--

Prashant Chamarty
The Startup

I am exploring how AI reshapes industries. I share insights on AI adoption, automation, ethics, and innovation.