The process of setting the hyper-parameters requires expertise and extensive trial and error. There are no simple and easy ways to set hyper-parameters — specifically, learning rate, batch size, momentum, and weight decay. Deep learning models are full of hyper-parameters and finding the best configuration for these parameters in such…