Remy Okazaki
Sep 6, 2018 · 1 min read

Sunny: YYN (entropy = 0.041)
Should entropy in this scenario instead be 0.28?

-1*(p(N)*log(p(N)) + p(Y)*log(p(Y)) ) =
-1*(0.33*log(0.33) + 0.67*log(0.67)) =
-1*(-0.16 + -0.12) =
0.28

(where log is base 10)

It looks like the 0.041 value given above was calculated: -1*(-0.16 — -0.12)= 0.04, i.e. second value is subtracted from the first before summation. Is this correct?