What You Need to Know Before Diving into Transformers

Understanding RNNs and Simple Terms of Neural Networks

Explained!

∘ A few things you should know before diving into transformers
∘ What is neural network?
∘ Basics of neural networks before diving into transformers
∘ Explanation of RNN in a very simple way
∘ Backward propagation, activation functions, and loss functions
∘ Brief explanation of the terms

A few things you should know before diving into transformers

1. Basic knowledge of machine learning: Machine learning is the field of study that gives computers the ability to learn without being explicitly programmed. It’s the foundation for deep learning. If you’re new to machine learning, you may want to start by learning about supervised and unsupervised learning, and common types of algorithms such as linear and logistic regression, k-nearest neighbors, decision trees and random forests.
2. Fundamentals of Neural Networks: A neural network is a type of machine learning algorithm that is modeled after the structure and function of the human brain. It is made up of layers of interconnected…