Whenever I tend to forget something, I just write a blog about it. This is my attempt to explain something that is super important and easy to forget!.
This blog post will be introduction to understanding Exponential Linear Unit (ELUs) activation function in Deep Learning. Best way to learn any concept is to code. I also recently submitted a PR to add ELU activation function in Apache System-ML.