AB Testing — So You Know What Really Works

adrian cockcroft
Mar 21, 2020 · 5 min read
‎⁨Castillo San Cristóbal⁩, ⁨San Juan⁩, picture by Adrian

When I joined Netflix in 2007 I was managing a team that built the personalized home page for the DVD shipping web site. The first thing I found was that every user visible change we made went through an A/B test. This was institutionalized across Netflix from the beginning, and it’s part of the formation story told in Marc Randolph’s book That Will Never Work. As an experienced product manager and the founding CEO…