Shake-Shake regularization with Interactive Code [ Manual Back Prop with TF ]

GIf from this website

Shake shake regularizer is a simple yet powerful method to generalize our model, and additionally the implementation is very simple.

And as always lets train our model using different optimizers to see which gives us the best results on the CIFAR 10 data set. Below are the list of cases that we are going to implement.