Backpropogating an LSTM: A Numerical Example

Aidan Gomez
Apr 18, 2016 · 5 min read

Syntactic notes

The forward components

The backward components

The Example

Forward @ t=0

Forward @ t=1

Backward @ t=1

Backward @ t=0

Errata and Frequently Asked Questions:

Aidan Gomez

Written by

Machine Learning at Oxford •

Welcome to a place where words matter. On Medium, smart voices and original ideas take center stage - with no ads in sight. Watch
Follow all the topics you care about, and we’ll deliver the best stories for you to your homepage and inbox. Explore
Get unlimited access to the best stories on Medium — and support writers while you’re at it. Just $5/month. Upgrade