Sep 6, 2018 · 1 min read
Thank you for your great explanation! Could you explain for me why in the fig. 2, self-information of direct delta function at the non-zero points is 0? According to the formula: I(p(x)) = — log(p(x)) = — log(0), should it be +∞?