Attention in Machine Learning

Photo by Alex Litvin on Unsplash

In this article, we will:

📌 Define attention

📌 Explore the types of attention

📌 Take a quick look at some common applications

The simplest explanation for attention is as on Wikipedia,

“In the context of neural networks, attention is a technique that mimics cognitive attention. The effect enhances the…