Published inTDS ArchiveParadigm Shifts of Eval in the Age of LLMLLMs requires some subtle, conceptually simple, yet important changes in the way we think about evaluation.Dec 31, 20246Dec 31, 20246
From Org Entropy to Micro-knowledging: 8 Lessons in Leading Engineering OrgsThe 2nd Law of Thermodynamics states that the total entropy of an isolated system can never decrease over time. The same is true for orgs.Jul 4, 2024Jul 4, 2024
Published inTDS ArchiveHow GPT works: A Metaphoric Explanation of Key, Value, Query in Attention, using a Tale of PotionGPT, explained simply, in a metaphor of potion.Jun 17, 20238Jun 17, 20238
Published inTDS ArchiveA Visual Explanation of Gradient Descent Methods (Momentum, AdaGrad, RMSProp, Adam)Why can AdaGrad escape saddle point? Why is Adam usually better? In a race down different terrains, which will win?Jun 7, 202023Jun 7, 202023
Published inTDS ArchiveAn Intuitive Explanation of Kernels in Support Vector Machine (SVM)We will walk through a simple example with basic arithmetics to demystify the concept of kernel.Apr 5, 2020Apr 5, 2020
Published inTDS ArchiveIntuitive Explanation of Cross EntropyI will draw a coin from a bag. Your goal is to guess the color with the fewest questions.Jan 18, 20195Jan 18, 20195
