Zero To One For NLP

Pratik Bhavsar
Jun 10, 2019 · 3 min read

All the best NLP resources out there

Come join Maxpool — A Data Science community to discuss real ML problems!

NLP has grown into a field of wide applications ranging from chatbots to news generation. I started my journey into NLP with standard courses but a majority of my practical learnings came from personal blogs of researchers. This metablog is a collection of my favourite blogs and courses I go through every once in a while to refresh myself.

As they say “Finding the right learning material is half the work.”

Basics

fastai

  1. Fastai ML
  2. Fastai DL
  3. Fastai NLP

Embeddings

Word2Vec

GLOVE

Attention

Language models

ELMO

Transformer

BERT

GPT-2 by Jalammar

BERT Vs GPT-2

XLNet by MLexplained

DistilBERT

ALBERT

Embeddings summary by Lilian Weng

Transfer learning

ULMFiT (Universal Language Model For Fine Tuning)

Ruder on Multi-task learning

Transfer learning

NN concepts

Normalisation

4 Sequence Encoding Blocks You Must Know Besides RNN/LSTM

Conversational AI

Neural Approaches review paper

What makes a good conversation?

Denny’s

Han’s

Rasa

Huggingface

Putting ML to production

Airbnb

Uber

Databricks Mlflow

Extra tips

Libraries

Semantic search

PyTorch

Random

Hackathons

AutoML

Interview

Papers and code

Interview question

Modern NLP

All the latest techniques in NLP — Natural Language…

Medium is an open platform where 170 million readers come to find insightful and dynamic thinking. Here, expert and undiscovered voices alike dive into the heart of any topic and bring new ideas to the surface. Learn more

Follow the writers, publications, and topics that matter to you, and you’ll see them on your homepage and in your inbox. Explore

If you have a story to tell, knowledge to share, or a perspective to offer — welcome home. It’s easy and free to post your thinking on any topic. Write on Medium

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store