How To Use Counterfactual Evaluation To Estimate Online AB Test Results
Published in
7 min readDec 22, 2019
Introduction
In this article, I will explain a principled approach to estimate the expected performance of a model in an online AB test using only offline data. This is very useful to help decide which set of model enhancements that should be prioritized to be validated using online AB test.
All code to reproduce the figures in this article can be found here.
