Sitemap
TDS Archive

An archive of data science, data analytics, data engineering, machine learning, and artificial intelligence writing from the former Towards Data Science Medium publication.

Member-only story

A Quiet Shift in the NLP Ecosystem

18 min readJun 29, 2022

--

Figure 1. An abstract illustration of emerging and growing capabilities of language models with increased model size. The utility of large language models goes beyond their ability to generate coherent stories — they could be leveraged to solve almost any NLP task — both generative and discriminative. Examples of this are noun phrase tagging, NER, relation extraction, classification, coreference resolution, semantic search (sentence embeddings), etc. Also for some of these tasks, the performance may be adequate for production use cases with fine-tuning. Image by Author — using information from Google’s PaLM model blogpost

The gist

Figure 2. Image from a recent paper (15 June, 2022)
Figure 3. Image from a recent paper (15 June, 2022)
Figure 3a. Image from a recent paper (15 June, 2022)

--

--

TDS Archive
TDS Archive

Published in TDS Archive

An archive of data science, data analytics, data engineering, machine learning, and artificial intelligence writing from the former Towards Data Science Medium publication.

Responses (6)