Understanding Memory in Deep Learning Systems: The Neuroscience, and Cognitive Psychology Perspectives

Memory is one of the emerging components of deep neural networks with strong root in neuroscience and psychology theory.

Source: https://medicalxpress.com/news/2017-02-human-brain-critical-short-term-memory.html

I recently started a new newsletter focus on AI education. TheSequence is a no-BS( meaning no hype, no news etc) AI-focused newsletter that takes 5 minutes to read. The goal is to keep you up to date with machine learning projects, research papers and concepts. Please give it a try by subscribing below:

TheSequence

Memory modeling is an active area of research in the deep learning space. In recent years, techniques such as Neural Turing Machines(NTM) have made significant progress setting up the foundation for building human-like memory structures in deep learning systems. In the past, I’ve written extensibly about the role of memory in artificial intelligence(AI) so I am not planning to bore you restating the same points. Instead, I would like to approach the subject from a different angle and…