Experimentation

Coming from a scientific background, experimentation in a business setting was initially confusing to me. As a ‘recovering’ physicist, the mental picture that appears when I hear “experiment” is always that of a scientific laboratory, where scientists wearing gloves add chemicals to containers and yell ‘Eureka!’ (this only happens rarely!)…

Recent OpenView PLG blogging has been addressing ungated value exchange. The basic premise is that the user represents value to the business, and vice versa. Much like other relationship building, to be successful, this exchange of value needs to be thoughtful and mutual. In this article I want to focus…

The 95% confidence interval currently dominates online and scientific experimentation; it always has. Yet it’s validity and usefulness is often questioned. It’s called too conservative by some [1], and too permissive by others. It’s deemed arbitrary (absolutely true), but that’s a good thing! I’m proponent of 95% confidence intervals and…

There are hundreds of case studies and examples of A/B testing. While A/B testing is important, it’s just a small fraction of the overall CRO process. AB testing isn’t foolproof and like anything in statistics, results can be inaccurate. But the more you know about what makes a test valid…

After a couple of decades of (almost) continued growth in the tech space, fueled by innovation (and pandemic-like events), where multiples skyrocketed and power-points were more common than spreadsheets in VC meetings, and getting funded became easier than getting revenue… reality (or correction, call it what you want) finally hit. …

Have a strong opinion about what problems you’re trying to solve, but be loose about how you’re going to solve them. This is something I’ve learned over the past year. The first version of your non-obvious idea on how to solve a problem is usually off the mark. So you…

Where am I? Peter looks around, confused. The room is dark and dimly lit with red lights, one above his head, and the rest illuminating what seems to be the heads of three men — sitting on separate seats, facing him. Who are these guys? Is this a dream? He…

Experiment Overview: Free Trial Screener To summarize, Udacity wants to test a change to the course enrollment process, where during the free trial checkout process, the student would be prompted to indicate the number of hours they can devote to the course. Control: Student clicks “Start Free Trial”, enters credit card information and begins 14…