Hyper-parameters used in Deep Learning

Figure 1: Parameter and Hyper parameter in Deep Learning Applications (Image Source: http://www.xlgps.com/article/317732.html)
Figure 2: Error value change when batch and mini-bath are applied (Image credit: Steven Schmatz)
Figure 3: Example dropout application (Image credit: Cristina Scheau)
Figure 4: Runtime graph of major optimization algorithms on MNIST dataset
Figure 5: Graphs of the most known activation functions

--

--

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store