Lili JiangFrom Org Entropy to Micro-knowledging: 8 Lessons in Leading Engineering OrgsThe 2nd Law of Thermodynamics states that the total entropy of an isolated system can never decrease over time. The same is true for orgs.Jul 4Jul 4
Lili JianginTowards Data ScienceHow GPT works: A Metaphoric Explanation of Key, Value, Query in Attention, using a Tale of PotionGPT, explained simply, in a metaphor of potion.Jun 17, 20238Jun 17, 20238
Lili JianginTowards Data ScienceA Visual Explanation of Gradient Descent Methods (Momentum, AdaGrad, RMSProp, Adam)Why can AdaGrad escape saddle point? Why is Adam usually better? In a race down different terrains, which will win?Jun 7, 202022Jun 7, 202022
Lili JianginTowards Data ScienceAn Intuitive Explanation of Kernels in Support Vector Machine (SVM)We will walk through a simple example with basic arithmetics to demystify the concept of kernel.Apr 5, 2020Apr 5, 2020
Lili JianginTowards Data ScienceIntuitive Explanation of Cross EntropyI will draw a coin from a bag. Your goal is to guess the color with the fewest questions.Jan 18, 20195Jan 18, 20195