Mahesh Khatri
Sep 27, 2018 · 1 min read

(Yet Another) Neural Network Terminology upto WX + B Stage

Neural networks are today at the core of the revolution in Deep Learning and Artificial Intelligence (AI). They have indeed travelled a long way since 3 decades ago when the director of US DARPA’s Tactical Technology Office called neural networks as “more important than the atom bomb”.

I recently set about preparing a Powerpoint presentation that builds up the neural network terminology in a step by step manner for the simple neural network consisting of 1 Input layer, 2 Hidden layers and 1 Output layer as shown in the figure below.

Image for post
Image for post

This was done to simplify my understanding of the many conflicting neural network terminologies out there. The final presentation slide shown below contains the terminology upto the WX + B Stage.

Image for post
Image for post

The link to the PDF of the slide deck (26 slides, 541 kb) is here.

Welcome all feedback on the same.

Welcome to a place where words matter. On Medium, smart voices and original ideas take center stage - with no ads in sight. Watch

Follow all the topics you care about, and we’ll deliver the best stories for you to your homepage and inbox. Explore

Get unlimited access to the best stories on Medium — and support writers while you’re at it. Just $5/month. Upgrade

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store