Modern NLP
Published in

Modern NLP

PyTorch For NLP

Let’s get rocking

Photo by Bradley Dunn on Unsplash

Why learn PyTorch?

  • The stats are showing that PyTorch is the framework for neural modelling and is going to stay for a while
  • People kept saying that PyTorch is not yet ready for production but it's not true anymore as companies are adopting it now
  • If you want to understand the new models and paper, most of them will be in PyTorch and will require you to know decent level PyTorch
  • PyTorch is very intuitive to understand
  • PyTorch has never frustrated me 😝

Why I wrote this?

There are many tutorials out there and the majority of them are on Computer Vision — GANs and stuff. The info on NLP with PyTorch is a bit scattered and it took me a while to figure out the best.

I hope with the below resources, you will have a better time than me.

1. Learn all the basics of PyTorch

2. Understand what is torch.nn

3. Get view inside PyTorch by Jeremy Howard

4. Learn more NLP from Fastai. This has the best code for transformer

5. Learn to write BERT in PyTorch

6. Learn to play with model layers in PyTorch

7. Understand PyTorch internals

8. Understand PyTorch in depth

9. Learn to add a new model to Hugging Face Transformers library

10. Insane transfer learning tutorial

BONUS: Understand PyTorch design

Want more?

Subscribe to Modern NLP for latest tricks in NLP!!! 😃




All the latest techniques in NLP — Natural Language Processing

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store
Pratik Bhavsar

Pratik Bhavsar

NLP & Semantic search engineer | Now writing on | | @nlpguy_

More from Medium

LitCoin NLP Challenge by NCATS & NASA

Tokenizers in NLP

Generating Quran-like Verses with AI

Stemming & Lemmatization