Cody Marie WildinTowards Data ScienceA Search for Efficient Meta-Learning: MAMLs, Reptiles, and Related SpeciesIt’s an oft-lamented fact that the capabilities of modern machine learning tend to be narrow and brittle: while a given technique can be…Sep 27, 20201Sep 27, 20201
Cody Marie WildinTowards Data ScienceConditional Love: The Rise of Renormalization Techniques for Neural Network ConditioningConditional renormalization is an oft-unsung technique powering many recent ML successes; how does it work and where did the idea come…Sep 8, 20192Sep 8, 20192
Cody Marie WildinTowards Data ScienceIt’s Only Natural: An Excessively Deep Dive Into Natural Gradient OptimizationThis post gives an intuitive explanation of an approach called Natural Gradient, an elegant way to dynamically adjust gradient step size.Mar 9, 20198Mar 9, 20198
Cody Marie WildinTowards Data ScienceGenerating, With Style: The Mechanics Behind NVIDIA’s Highly Realistic GAN ImagesA new architecture, designed to leverage noise and allow for precise configuration of global features, is generating impressive resultsJan 21, 20191Jan 21, 20191
Cody Marie WildinTowards Data ScienceA Tale of Two Convolutions: Differing Design Paradigms for Graph Neural Networks“Graph” is a one of those terms that’s fallen prey to natural language’s tendency to be less precise than its mathematical counterpart.Dec 27, 20184Dec 27, 20184
Cody Marie WildinTowards Data ScienceConvolution: An Exploration of a Familiar Operator’s Deeper RootsIn the world of modern machine learning, the convolution operator occupies the strange position: it’s both trivially familiar to anyone…Oct 1, 20185Oct 1, 20185
Cody Marie WildinTowards Data ScienceThe Pursuit of (Robotic) Happiness: How TRPO and PPO Stabilize Policy Gradient MethodsReinforcement Learning strikes me as the wild west of machine learning right now: a place full of drama and progress, with dreams of grand…Jul 9, 20185Jul 9, 20185
Cody Marie WildinTowards Data ScienceWith Great Power Comes Poor Latent Codes: Representation Learning in VAEs (Pt. 2)(If you haven’t done so yet, I recommend going back and reading Part 1 of this series on VAE failure modes; I spent more time there…May 7, 20186May 7, 20186
Cody Marie WildinTowards Data ScienceWhat a Disentangled Net We Weave: Representation Learning in VAEs (Pt. 1)It’s a truth universally acknowledged: that data not in possession of labels must be in want of unsupervised learning.Apr 15, 20187Apr 15, 20187
Cody Marie WildinTowards Data ScienceLearning About Algorithms That Learn to LearnThe premise of meta learning was an intoxicating one to me, when I first of heard it: the project of building machines that are not only…Mar 24, 20182Mar 24, 20182
