Senior Robotics Software Engineer @ Rapyuta Robotics

By far the most relevant and clear explanation for understanding the fundamentals of Entropy. Looking forward to read Cross Entropy.

Authors understanding of the subject is reflected in the explanation. Only clarity of subject can deliver such clear explanation. Most of the articles on internet throws jargon and formulas out of no where making the matter look even more convoluted than it really is.

I am wondering is it undefined? When Q=0, we got 0 at the denominator which is undefined in term of mathematics. Moreover, log 0 yields undefined. Could you please help me to understand this concept? Thanks.

Really interesting article… It helps clear my mind regarding to information theory and their hack on ML field… Next, variational auto-encoders please…

Your demystifying articles are crystal clear. Please do write about VAE

Nice work!

I’ve never seen an explaination in such an elegant way before.

Can I translate your article for my class?

Fantastic explanations. well done!

I started off with http://hanj.cs.illinois.edu/cs412/bk3/KL-divergence.pdf then brought it back to machine learning with this article which was nicely written. Thanks.

Thank you so much for this tutorial. I have found it extremely helpful :)

Awesome job at explaining it!!