The Great Pumpkin
Feb 23, 2017 · 1 min read

Hi Arthur,

thanks for the quick response! I thought about your answer and I wonder:

Why do we force the model to make definitive statements? Sure, with classification the target is always an one-hot encoded vector, so it would make sense to output vectors “close” to one-hot encoding. If the model is right, it will be completely right, but if the model is wrong, it will be completely wrong.

Suppose, I am randomly thinking of a number between one and two. The model has to guess it. Would a good model answer with definitive statements or with 50% 1, 50% 2?

    The Great Pumpkin

    Written by

    https://theblog.github.io

    Welcome to a place where words matter. On Medium, smart voices and original ideas take center stage - with no ads in sight. Watch
    Follow all the topics you care about, and we’ll deliver the best stories for you to your homepage and inbox. Explore
    Get unlimited access to the best stories on Medium — and support writers while you’re at it. Just $5/month. Upgrade