7 Hacks for Lean User Research

Alkistis Mavroeidi
Sep 4, 2018 · 7 min read

A UX Designer’s guide to getting over User Research struggles.

Unless you have the luxury of working closely with a UX Researcher, Lean User Research is a term you’ll probably love and hate. You love it, because it means that you can do all the things you want. You hate it, because it also means that you have to do them with limited resources.

In my journey as a UX Designer at KAYAK, I’ve been involved in developing our own guidelines of Lean User Research, all the way from evangelizing its need, to developing and increasing its impact. Thankfully, there was always great material out there created by the explorers and pioneers of Lean User Research. These resources aim to help teams of “one or slightly more” to get jumpstarted with user testing, user interviews or other studies with guerrilla methodologies.

So now is the time for me to share my collection of top hacks for getting over some of the obstacles of Lean User Research.

Recruiting

1. Internal user testing

It is admittedly the fastest way to user test your products. Plus, you get extra points for spreading some UX evangelization across the different teams of your company. Way to go!

2. Street testing? Line ’em up.

When we decided to try our luck with street user testing, we started by setting up a table at a nearby mall. Getting the first people to accept was difficult, in spite of the strategically placed gift cards and engaging “Love Travel?” signs. Our luck changed when a group of four people agreed to user test. As two people sat down to talk and two formed a line to wait their turn, something miraculous happened. People started being interested on their own and lined up behind them. No more recruiting was needed, we just brought more laptops and sat down to talk to our user testers.

In the end, peer interest was a much more effective recruiting mechanism than us asking people proactively. Next time, get a group of user testers to line up — starting with some colleagues if necessary.

3. Recycling

  • A bad user tester will keep asking you if that’s what you want to hear and will come up with wildly innovative ideas to try to impress you.
  • A good user tester will feel comfortable thinking out loud, will explain clearly what they are looking for and what confuses them.

If you get the latter, don’t be afraid to invite them back! Ask them if it’s okay to contact them again for future user testing, and keep a record of what part of the product they tested. Make sure you don’t use them for the same product twice, as that could create an unwanted bias.

Which leads to our next challenge…

The interview process

4. Have users read instructions out loud

To make this process a little less awkward, try preparing the instructions as a slideshow and have the user go through it by reading it out loud. That way you achieve 2 goals:

  • First, it makes the user read through it carefully. If you are given a piece of paper to read under the pressure of people waiting for you, you tend to skim through it fast to avoid the awkward silence.
  • Secondly, it warms the user up to them doing most of the talking. By having them read out loud uninterrupted, the user gets in the habit of talking out loud and hearing mostly their own voice.

5. White lies (“I haven’t worked on this”)

I personally like to push a little more by encouraging people to be critical, as it balances the natural tendency to compliment someone’s work.

6. Create a scenario relevant to a past experience

“Would you have clicked on that if I wasn’t here?” asked the KAYAK interviewer.

“Probably not.” said our tech-savvy, curious and investigative user tester, in a moment of honesty.

One way to eliminate the make-believe parameter, is to relate the script to an experience the user already had. As KAYAK in particular is focused on travel, sometimes it’s difficult to find recruits that are currently planning a trip. To help them relate to the scenario of the task, we adapt it to their previous experience.

An example of that would be a user who traveled a month ago with their partner to California for a wedding. We ask them to plan for that same trip but now as if it was set in the future (let’s say 2 months from now). Noting down details, like which days of the week they traveled on, can help bring out things that were important for that particular trip. For example, one of our testers had to accommodate their partner’s very strict work schedule into planning, meaning that filtering the departure times was way more important to them than to our average user.

7. Neutrality

One good trick to make this situation more comfortable is to keep yourself busy by writing notes and to let the user get out of situations on their own. If you feel like you have to give a response, have some neutral replies ready to use.

  • What do you think?
  • What would you expect? / What that what you expected?
  • I will answer that question for you after the test.

As Lean User Researchers, every user testing session brings us closer to optimization. As you develop your skills as recruiter, facilitator and interviewer, you will end up with your own list of rules and hacks that make this process effective and as painless as possible. Remember that the most important goals you should aim for is streamlining recruitment, avoiding bias and creating a comfortable environment for the user tester that will help you get as honest of a response as possible. Keeping track of these values, and you will be a force that brings your product closer to the user.

Are you a Lean User Researcher? What are some hacks you have on your list?

KAYAK Tech

Stories and articles from the people behind travel at KAYAK.