The Data “Never” Lies

Nick Rosener
Jul 3, 2016 · 2 min read

How to Get the Truth from Marketing Data

Image for post
Image for post

Let’s talk about how to spot (and prevent) common statistical issues with analyzing your marketing campaigns.

If you’ve worked with marketing data (especially data from social media analytics, experiments, email tracking, etc.), seeing the results of your marketing efforts in the dashboard of some analytics tool can carry a beautiful feeling of certainty.

You put up an ad. People click on it. People buy something. Seems pretty straightforward, right?

Well, it’s not quite so straight-forward in practice.

Sometimes, your marketing analytics can lie to you.

Recently, I gave a talk on exactly this topic at .

The main takeaway of the talk was this: if you’re troubleshooting a marketing campaign there are two types of issues you can be having.

  • Marketing issues, which are the “real problems” with your campaign
  • Statistical issues, which cause you to “come to the wrong conclusion without about your campaign without realizing it”

I cover:

  • A model for thinking about “conversion rate experiments” for social media advertising campaigns.
  • An answer to the question “How much do I have to spend to test an ad?”
  • Common pitfalls when setting up social media experiments.

Watch the Full Talk

I’ve also posted the and (with “safe for client use” whitelabel-able open source license).

The talk begins at 8:45.

Read the for extra downloadable resources, links to recaps by the Social Media Breakfast Crew, and photos from the talk.

Welcome to a place where words matter. On Medium, smart voices and original ideas take center stage - with no ads in sight. Watch

Follow all the topics you care about, and we’ll deliver the best stories for you to your homepage and inbox. Explore

Get unlimited access to the best stories on Medium — and support writers while you’re at it. Just $5/month. Upgrade

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store