Learning Rate (from Stackoverflow)


Training iteration. In the training process , weights will update in every iteration, Under normal circumstances,loss is decrease meanwhile prediction accuracy increase.

If u find loss and accuracy trend are abnormal through many training iteration, u should stop and adjust hyperparameter or network architecture.

batch size(from Stackoverflow)