Sitemap
Acta Schola Automata Polonica

Scientific blog about artificial intelligence and machine learning

Follow publication

Visualizing LSTM Networks

10 min readMar 17, 2018

--

and .

Abstract

Auslan sign classifier

Figure 1. Model architecture

First attempt to understand the internals of the LSTM network

Denoising Autoencoders

Figure 2. Autoencoder architecture

Visualization

Figure 3. LSTM activations visualization
Figure 4. Last activations from LSTM layer
Figure 5. 3D visualization of LSTM activations

Analysis

Figure 6. Activation paths categorized by hand usage
Figure 7. LSTM activations for drink and danger
Figure 8. LSTM activations for who and soon
Figure 9. LSTM activations for think and crazy
Figure 10. LSTM activations for think, crazy, sorry and you

Misclassified examples

Figure 11. Misclassified examples for training set
Figure 12. Misclassified examples for validation set
Figure 13. Misclassified examples for test set

Prediction visualization

Figure 14. LSTM prediction visualization

Conclusions

References

--

--

Acta Schola Automata Polonica
Acta Schola Automata Polonica

Published in Acta Schola Automata Polonica

Scientific blog about artificial intelligence and machine learning

Responses (11)