Stochastic vs Mini-batch training in Machine learning using Tensorflow and python

In the simplest term, Stochastic training is performing training on one randomly selected example at a time, while mini-batch training is training on a part of the overall examples.

Mini-batch sizes may vary depending on the size of your data. In a later tutorial, I will show you some best practices in picking a good mini-batch size.

Note: We are going to implement and visualize these training using Tensorflow and python. Lets start with stochastic training.