PyTorch For NLP

Let’s get rocking

Photo by Bradley Dunn on Unsplash

Why learn PyTorch?

• The stats are showing that PyTorch is the framework for neural modelling and is going to stay for a while
• People kept saying that PyTorch is not yet ready for production but it's not true anymore as companies are adopting it now
• If you want to understand the new models and paper, most of them will be in PyTorch and will require you to know decent level PyTorch
• PyTorch is very intuitive to understand
• PyTorch has never frustrated me 😝

Why I wrote this?

There are many tutorials out there and the majority of them are on Computer Vision — GANs and stuff. The info on NLP with PyTorch is a bit scattered and it took me a while to figure out the best.

I hope with the below resources, you will have a better time than me.

1. Learn all the basics of PyTorch

hunkim/PyTorchZeroToAll

2. Understand what is torch.nn

What is torch.nn really? - PyTorch Tutorials 1.3.1 documentation

3. Get view inside PyTorch by Jeremy Howard

4. Learn more NLP from Fastai. This has the best code for transformer

fastai/course-nlp

5. Learn to write BERT in PyTorch

codertimo/BERT-pytorch

6. Learn to play with model layers in PyTorch

Important Pytorch Stuff

7. Understand PyTorch internals

PyTorch internals

8. Understand PyTorch in depth

Ayoosh Kathuria - Paperspace Blog

9. Learn to add a new model to Hugging Face Transformers library

Add ALBERT to the library by LysandreJik · Pull Request #1683 · huggingface/transformers

10. Insane transfer learning tutorial

Google Colaboratory

BONUS: Understand PyTorch design

PyTorch: An Imperative Style, High-Performance Deep Learning Library

Want more?

Subscribe to Modern NLP for latest tricks in NLP!!! 😃

Modern NLP