How to get started with A/B tests on Raisely.

Jamie Ling
Raisely
Published in
3 min readAug 8, 2018
Photo by Tanya Nevidoma on Unsplash

First, lets take a quick step back and ask “What is an A/B test and why should I try and optimise my donation page?”

A/B testing

“A method of comparing two versions of a webpage or mobile app experience against each other to determine which performs best”

An Optimisation Glossary from Optimizely

Optimising your Raisely page

It’s safe to say that not everyone who comes to your fundraising page will make a donation. Any improvement on the conversion rate of your page is a good thing.

Testing variations of your original page allows you to experiment with ideas that you think might increase conversion.

The quality and nature of your traffic will naturally impact your conversion rates as well but we’ll save the importance of segmentation for another day.

Setting up Google Optimise

We’ll assume you have Google Analytics set up already for your Raisely campaigns. If you have not done that here is the how to document.

Follow in the instructions in this great from video from Loves Data but skip the google tag manager* step.

https://www.lovesdata.com/

*Raisely has an integration with Optimize so you can add your Optimise Tag here.

Step 1: Setting your variants

Original
This is your baseline that you are comparing against.

Variant A
For demonstration purposes we have created a variant with a much larger title on the donate form and removed the numbered steps.

Creating your variant

2.Setting your objectives (goal)

Set your custom objective as an event.

Events are automatically pushed from Raisely to Google Analytics when you connect the services. This is a list of events that Raisely sends to Google Analytics.

The easiest and most obvious event to start with would be Revenue - this can be selected here and looks like this 👇

3.Set your targets

The who and the when.

To keep it simple we have split the traffic 50 / 50 to the original page and variant A. The “when” is when the exact URL is matched.

4. Analyse the results and win the argument 🙄

Once the time frame you have selected has elapsed its time to check your data and see which page won or what the statistically significant difference was.

“Statistical significance is the likelihood that the difference in conversion rates between a given variation and the baseline is not due to random chance.”

An Optimisation Glossary from Optimizely

You can work out whether your experiment achieved significance with this handy calculator tool.

And finally

Remember to test big changes these will likely have the most impact. Here are some ideas of things you could test on your Raisely page now you know how to get started.

  • Headings
  • Button colours
  • Calls-to-action
  • Images and video
  • Page layout

Happy experimenting 👩‍🔬

Get an overview of what Raisely can do for you and your organisation with a 30 minute video-call presentation at demo.raisely.com or just go ahead and sign up for free.

--

--

Jamie Ling
Raisely
Editor for

Head of Growth at Raisely. Former Digital mischief maker at Greenpeace, filler of dance floors and grower of vegetables