(Yet Another) Neural Network Terminology upto WX + B Stage

Neural networks are today at the core of the revolution in Deep Learning and Artificial Intelligence (AI). They have indeed travelled a long way since 3 decades ago when the director of US DARPA’s Tactical Technology Office called neural networks as “more important than the atom bomb”.

I recently set about preparing a Powerpoint presentation that builds up the neural network terminology in a step by step manner for the simple neural network consisting of 1 Input layer, 2 Hidden layers and 1 Output layer as shown in the figure below.

This was done to simplify my understanding of the many conflicting neural network terminologies out there. The final presentation slide shown below contains the terminology upto the WX + B Stage.

The link to the PDF of the slide deck (26 slides, 541 kb) is here.

Welcome all feedback on the same.