NLP from beginning — LSTM

update: 2019/06/20。2nd, 3rd, 5th, 6th image updated； reference updated。

I wrote a post about why LSTM cannot prevent gradient exploding from happening.

As usual, I was taught by online sources very much. This is a summarization of learning LSTM. If you are still new to RNN, I recommend my previous article. Also, references below are super useful.

My article about RNN: https://medium.com/@CecileLiu/nlp-from-beginning-rnn-8a72afcdfa94

Reference:
http://colah.github.io/posts/2015-08-Understanding-LSTMs/
https://github.com/nicodjimenez/lstm
http://cs231n.github.io/neural-networks-1/
https://www.youtube.com/watch?v=rTqmWlnwz_0

1

2

3

4

5

6

7

8

9

10

11