NLP Zero to One: Deep Learning Theory Basics (Part 3/30)

Perceptron, Neural-Nets, Activation Functions

Kowshik chilamkurthy
Mar 2 · 5 min read
Generated by author

Introduction..

Basic computing unit: Perceptron Algo..

Fig-1: Perceptron algo in single Neuron ( basic computational unit in Neural Nets)
Generated by Google Jam-board

Feed-Forward, Fully Connected NN..

Illustration of single layer NN, generated by author

Non-Linear Activations Functions

Source [1]

Sigmoid

Tanh

Relu

Note:

Leaky Relu functions from Ref.1
Softmax funciton from Ref.1
Generated by author

Nerd For Tech

From Confusion to Clarification

Nerd For Tech

NFT is an Educational Media House. Our mission is to bring the invaluable knowledge and experiences of experts from all over the world to the novice. To know more about us, visit https://www.nerdfortech.org/.

Kowshik chilamkurthy

Written by

RL | ML | ALGO TRADING | TRANSPORTATION | GAME THEORY

Nerd For Tech

NFT is an Educational Media House. Our mission is to bring the invaluable knowledge and experiences of experts from all over the world to the novice. To know more about us, visit https://www.nerdfortech.org/.