See more
And if the learning rate is too high, he would instantly start to believe that all dogs are white even though he has seen more black dogs than white ones.
But with a low learning rate, he would consider the white dog as an outlier and would continue to believe that all dogs are black.
Imagine he’s shown a white dog, and his parents tell him that it’s a dog. With a desirable learning rate, he would quickly understand that black color is not an important feature of dogs and would look for another feature.