Fundamentally, all user research answers one of two questions: (a) Who are our users and what are they trying to do? (b) Can people use the thing we’ve designed to solve their problem? You answer the first question with a field visit and you answer the second question with a usability test.
Field research answers the question, “Who are our users and what are they trying to do?”
A field study focuses on the big picture: how people currently solve their problem. With field research, you examine the workflow across multiple channels and observe user behaviours, needs, goals and pain points. Field research is fundamentally outward looking: your aim to find out what’s happening in the real world.
The typical research location is a participant’s home or workplace. You’re looking to discover how people achieve their goals right now, before your system has been built or invented. What problems do users face? What needs do they have? What are their skills and motivations?
Lean Startup researchers characterise this as ‘getting out of the building’—but getting out of the building isn’t enough. A field visit is much more than a pop-up user interview in a coffee shop. To use the analogy of animal behaviour, an interview is like a visit to the zoo whereas field research is like going on safari. With field research you observe real behaviour: you see what people do, not listen to what they say they do. In short, you go where the action happens.
Without field research, you’re designing in the dark. With field research, it’s like someone has turned on the room lights.
Again, in the language of Lean Startup, field research helps you validate (or invalidate) the problem hypothesis. Is the problem that you’re trying to solve for users really a problem? Design teams often experience a kind of groupthink where they believe they are solving a real user need—but in fact few users are bothered by the problem. One of my favourite examples is the connected kitchen from Hoover. When I discuss this with people, most people agree that it would be cool to have your washing machine send you a text when it has completed its cycle, but ‘cool’ doesn’t necessarily mean useful.
The other issue you’ll uncover with your field visit is how serious a problem this is. Some problems aren’t so serious for people that they are willing to spend time or money solving them. You may have discovered an itch, but a field visit will show you if your customers are happy with their current way of scratching.
Usability testing answers the question, “Can people use the thing we’ve designed to solve their problem?”
A usability test focuses on how people do specific tasks and the problems they experience when using a particular system. Traditionally it takes place in a lab, but in practice it can take place anywhere (including the field). Typical research locations include:
- A participant’s home or workplace.
- Public spaces, like coffee shops and libraries (so called ‘pop-up research’).
- Research studios or labs.
- Meeting rooms
- Your desk (using a laptop or phone for remote research).
Usability testing is fundamentally inward looking: you give your users a prototype and a set of tasks and you see if they can complete those tasks.
The key difference between a usability test and a field visit is that with a usability test you’re evaluating a specific design idea with your users. If a field visit is like turning on the lights, then a usability test is like looking under the microscope. Field visits give you the big picture whereas a usability test lets you evaluate a specific solution.
To use the language of Lean Startup, a usability test helps you validate (or invalidate) the solution hypothesis: does your proposed solution work?
Should I run a field visit or a usability test?
Field visits and usability tests are complementary research techniques so you need to do both.
A field visit tells you if you’re designing the right thing. A usability test tells you if you’ve designed the thing right. For example, your product might perform fine in a usability test but it will fail if people don’t really care about the tasks you’ve asked them to complete.
Your choice of method depends on where you are in your development lifecycle.
If you’re in the discovery phase, you should be carrying out field visits to turn on the lights. This is because you want to answer the question, “Who are our users and what are they trying to do?”
Once you’ve understood the problem, it’s time to get out your microscope and usability test your design solution with users. This is because you want to answer the question, “Can people use the thing we’ve designed to solve their problem?”
In summary, you simply need to ask two questions:
- What is the user problem to be solved? (If unsure, carry out field research).
- Have we solved it? (If unsure, carry out usability testing).
Why not join the thousands of other people taking my free online user experience lessons?
Originally published at userfocus.co.uk.