(Yet Another) Neural Network Terminology upto WX + B Stage

Neural networks are today at the core of the revolution in Deep Learning and Artificial Intelligence (AI). They have indeed travelled a long way since 3 decades ago when the director of US DARPA’s Tactical Technology Office called neural networks as “more important than the atom bomb”.

I recently set about preparing a Powerpoint presentation that builds up the neural network terminology in a step by step manner for the simple neural network consisting of 1 Input layer, 2 Hidden layers and 1 Output layer as shown in the figure below.