Always collect feedback from candidates anonymously

This data from our A/B testing shows you why

Simon Werner-Zankl
Nov 1, 2017 · 3 min read

As i have written in this article one of the key components to get a high response rate is to collect it anonymously. I will give you the full story so that if you are going to collect feedback, Candidate Net Promoter Score or any other feedback from candidates, please read this first to understand the importance of anonymity.

Setting the parameters for A/B testing

At first we needed to define a clear cut goal with this A/B testing. A goal here has to be focused around only answering one thing. We set the goal to be:

Will the response rate go down if the part about being anonymous is not mentioned?

So the test A is: sending 1000 e-mails not mentioning anonymity(it still is anonymous, but just not mentioned).

The test B will then be: sending 1000 e-mails mentioning the anonymity two times.

We will choose the A/B that produces the highest response rate. One last important thing is that all else has to be equal.

The results

The results where actually better than i thought! In test A we got 343 that submitted feedback and in test B we got 24,2% more landing at 426 submitting feedback.

As you can see in the graph above the winner was test B mentioning the anonymity and today we send all forms mentioning anonymity.

Other things we started thinking about along the way

This was the first A/B tests we conducted and it got us started thinking about other areas important to do some research on. I will just mention them below. Some has been A/B tested already and some are on its way.

  • How will it affect the candidate if the sender is not the company you visited? For example if IKEA conducted an interview and sends a form from IKEA, how will the response rate change if it is sent from Feedback Inc on behalf of IKEA?
  • Further elaborating around the sender, how will the sender being IKEA vs. Feedback Inc effect the validity and honesty of the feedback submitted?
  • Does the length of the e-mail effect response rate?
  • Does including logo of IKEA effect response rate/validity/honesty?
  • Does including the Feedback Inc logo effect response rate/validity/honesty?

As always i am more than happy to discuss recruiting and the challenges further so feel free to comment, hook up with me on Linkedin here or send me an email: 👋.

PS. If you found this helpful and want to read more like this article please Clap 👇or follow this blog data-driven HR.

Candidate Experience Analytics

Your knowledge resource for Candidate Experience & HR Analytics | by Trustcruit

Candidate Experience Analytics

A resource center for articles about candidate experience, HR analytics, and data-driven HR

Simon Werner-Zankl

Written by

Passionate about data driven HR, startups and true believer that passion never fails.

Candidate Experience Analytics

A resource center for articles about candidate experience, HR analytics, and data-driven HR