Usability Testing: A Founder’s Guide

No excuses! You should be testing your product with users.

UXDNinja
UXDNinja
Apr 30, 2019 · 4 min read

People care more about eXperiences than features; in the market, 1 in 5 products fail due to an unfriendly product eXperience.How can we prevent ourselves from this awful fate?

“Give users what they need, duh!”

It seems simple, yet we’ve seen company after company get this wrong; they don’t include the user in any stage of their product creation. In fact, a McKinsey study showed that 40% of the surveyed companies do not talk to their end users during development.

Without an understanding of what the user needs are, how can a company hope to add value to their users?

Welcome to the world of user research! To help make the user research process more approachable, we’re starting a series, the Founder’s Guide to UX Research, where we break down methods that will help you and your product team understand your users, improve your product eXperience, and exceed your business goals.

Let’s begin! Today’s topic: usability testing.

What is usability testing?

Usability testing is a fast and effective way to test how well your product will work with users and should ideally be done before products are released to the public.

Testing with merely 5 users can capture up to 80% of all the usability issues in your product, significantly decreasing the risk of launching an unintuitive product.

What outcomes can you expect?

  1. Seeing how easy your product is to use
  2. Validating if you made the right design decision
  3. Assessing how your product compares to others

Usability tests must be done when you have a prototype that can be shown to users. The prototype can be of varying fidelities — from sketches to developed prototypes. Since testers may differ in their understanding of sketches versus prototypes, the quality of the feedback is directly correlated to the fidelity of the prototype.

Sometimes, a “smoke and mirrors” prototype may work just as well as fully functional software in testing.

Unmoderated vs Moderated: Benefits and Constraints

Unmoderated usability testing

Benefits:

  1. Highly time efficient — Since the studies are done on an online platform, recruitment time is significantly decreased, and all studies are typically filled within an hour.
  2. Wider reach of participants — Online distribution of the study means that geography is not a constraint.
  3. Cost-effective — Unmoderated studies are typically 15–30 minutes, and are about one-third the cost of conducting a moderated study.

Constraints:

  1. Lower fidelity of insights — When the researcher isn’t present with the tester, they lose the ability to follow up on participant words and behavior. Instead, the user will have to triangulate from different data sources other than digging deeper with tailored questions.
  2. Higher fidelity prototype recommended — Since the researcher isn’t present with the participant during testing, the prototype must be higher fidelity to make the intent and actions clearer to the participant. If the participant goes through the prototype with a misunderstanding of the interface, the researcher might end up with confounding data.
  3. Unable to read body language — Body language constitutes a huge part of communication. Unfortunately, the researcher’s ability to pick up on body language cues from the user impacts the researcher’s understanding of user reactions.

Moderated usability testing

Benefits:

  1. High fidelity of insights — Researchers can ask follow up questions to gather deeper insights.
  2. Flexible fidelity of prototype — A lower fidelity prototype may be used since the researcher is present to clarify any questions on the prototype.
  3. Contextual observation — A lot of data shows you HOW someone did something but not WHY. When the researcher is present with the user, it’s easier to understand more factors, such as environment, and observe nuanced reactions that are lost in looking at data on the screen.

Constraints:

  1. Geography, time, and cost — In an ideal world, user problems would be solved by local teams who have deep insights into their environments and contexts. Unfortunately, this is not always the case, and it takes time and resources to meet the users in their natural setting.

About UXDNinja

UXReactor

UXReactor is a full-service User eXperience (UX) design…

UXReactor

UXReactor is a full-service User eXperience (UX) design firm who helps teams and organizations of all maturity optimize their user-centered focus to deliver useful, usable and desirable products. We are problem solvers who love to drive business outcomes for our partners.

UXDNinja

Written by

UXDNinja

UXDNinja is an initiative of UXReactor, Inc. that uses research and design to help teams improve the efficacy and desirability of their products.

UXReactor

UXReactor is a full-service User eXperience (UX) design firm who helps teams and organizations of all maturity optimize their user-centered focus to deliver useful, usable and desirable products. We are problem solvers who love to drive business outcomes for our partners.

Medium is an open platform where 170 million readers come to find insightful and dynamic thinking. Here, expert and undiscovered voices alike dive into the heart of any topic and bring new ideas to the surface. Learn more

Follow the writers, publications, and topics that matter to you, and you’ll see them on your homepage and in your inbox. Explore

If you have a story to tell, knowledge to share, or a perspective to offer — welcome home. It’s easy and free to post your thinking on any topic. Write on Medium

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store