Over the same period, we drove month one retention from 88% to 90% — both retention and our “simple” metric moved together. We chose not to take the time, however, to execute a large-scale A/B test because we were confident that the more straightforward experience improved retention.
The proxy metric we devised was “the percentage of new members who add at least three titles to their queue during their first session.” When we first looked at the data, 70% of new members added at least three titles to their queue during their first session. By the end of the year, after a series of fast-paced experiments, we increased this percentage to 90%.
…nt AMI could cause me takes a back seat because there’s a much more important matter involved here. If in my position I can’t stand up to this kind of extortion, how many people can? (On that point, numerous people have contacted our investigation team about their similar experienc…
…n offer I couldn’t refuse. Or at least that’s what the top people at the National Enquirer thought. I’m glad they thought that, because it emboldened them to put it all in writing. Rather than capitulate to extortion and blackmail, I’ve decided to publish exactly what they sent m…
…eign design challenge, I find it refreshing to learn about the rigor they applied to their process. Calvert and Kinneir spent years testing for legibility in all different conditions. They would create prototype signs and prop them up against trees to determine the most effective background colors and reading distances. They would then drive past their prototypes at 60mph. At night. In the rain. When safety is concerned, all edge cases matter.
Important things never really happen at a meetings. If something does happen it is right at the end when everyone has to pee and half the people are out the door. The biggest mistake people make is thinking the meeting is the peak moment or end of a long process, when in reality meetings are steps along the way to collaborating and converging.
Qualitative research is hard because it requires so much interpretation. Researchers have to filter what they’re hearing to compensate for low fidelity, self-reporting bias, and the simple fact that users haven’t spent time analyzing their own fundamental needs. These challenges are nothing new; but with the increased use of design thinking outside design, we don’t always recognize them. There’s a sense, within and outside design, that we can validate an innovative idea by putting sketches in front of people and asking what they think.