Zero To One For NLP
All the best NLP resources out there
Come join Maxpool — A Data Science community to discuss real ML problems!
NLP has grown into a field of wide applications ranging from chatbots to news generation. I started my journey into NLP with standard courses but a majority of my practical learnings came from personal blogs of researchers. This metablog is a collection of my favourite blogs and courses I go through every once in a while to refresh myself.
As they say “Finding the right learning material is half the work.”
Basics
- Intro to NLP(Theory) — Stanford OR Jurafsky & Manning book
- Spacy 101
- Text Mining
- Coursera sequence models
- CS224n — Natural Language Processing with Deep Learning — 2019
- BigO for Data Scientists
fastai
Embeddings
Attention
Language models
Embeddings summary by Lilian Weng
Transfer learning
ULMFiT (Universal Language Model For Fine Tuning)
Transfer learning
NN concepts
- Improving NNs
- Why momentum works?
- Learning-rate-tuning
- Cyclical Learning Rates
- Pros and cons of activation functions
Normalisation
4 Sequence Encoding Blocks You Must Know Besides RNN/LSTM
Conversational AI
Neural Approaches review paper
What makes a good conversation?
Denny’s
Rasa
- Bot levels
- Level 3 bot
- 13 rules for chatbot design
- Rasa NLU in Depth: Part 1 — Intent Classification
- Rasa NLU in Depth: Part 2 — Entity Recognition
- Rasa NLU in Depth: Part 3 — Hyperparameter Tuning
Huggingface
Putting ML to production
- Full Stack Deep Learning
- Rules of ML by Google
- Deploying ML models
- Deploying NLP models
- ML system design
- ML Ops Day — Oscon 2019
- Deploying transformers
- Technical debt in ML
- Model management
Airbnb
Uber
Extra tips
- Training NN on GPUs
- pytorch-lightning
- Distributed training in pytorch
- Faster training with large batches
Libraries
Semantic search
PyTorch
Random
- Tricks in NLP
- Tranformers time benchmarking
- Text data augmentation
- Topic modelling by Nanonets
- How to detect fake text?
- An Embarrassingly Simple Approach for Transfer Learning
- Machine Learning Fairness