Running a Usability Study: A Checklist

So, you have your study all designed out, you’ve booked your participants, your prototypes are wired up and ready for consumption… Now what?

As I’ve said before, I’m a bit of a checklist fanatic. This is the checklist I use to ensure a usability test runs smooth as butter. (Or at least, to minimize the chance of total mayhem.) This is specific to my processes: feel free to take it, modify it and shape it to your needs.

Before the Study

• Has the test plan reviewed by other designers? By the team lead? By the product owner?
• Have you setup and tested the relevant software: Adobe Connect? Morae? Optimal Workshop?
• Have you confirmed the participant has the technology they need, if any*: Computer? Internet connection? Phone? Webcam? Mic?
• Have you sent the NDA to the participant(s)?
• Have you sent the location, URL, dial-in number to the participant(s)?
• Have you confirmed time, date and time zones with the participant(s)?
• Have you prepped and/or printed the required materials: Prototypes? Reference documents?
• Have you done one or more dry-runs?
• Have you tested the recording equipment?
• Have you booked the meeting room at least 15 minutes in advance of the test to allow for setup?
• If the test is being done online: have you invited developers, QA, other team members or other stakeholders to watch or listen-in?

* Avoid unnecessary technology wherever possible. It will make running your study much easier.

During the Study

• If the test is run in-browser: are you in Incognito mode or have your extensions otherwise disabled?
• Have you gotten participant consent to record?
• Is the recording equipment on and ready?

After the Study

• Have you sent the participant(s) remuneration?
• Have you posted the recording or otherwise shared the results with your team?
• Have you updated the participant database?

Have I missed anything or have some tips to add? Let me know your thoughts!