Eye-tracking in Usability Testing

Peter Zalman
Jun 21, 2016 · 3 min read

There are a couple of common design patterns that can be seen across the product portfolio here at CA Technologies. These patterns include monitoring dashboards, configuration data grids or topology maps.

Recently, I wanted to evaluate, how we can use eye-tracking technology to test and improve usability of these common patterns. I have previous experience with the technology, but the enterprise environment represents a different challenge when it comes to user research. My goal was to start small, borrow the camera for one-time only event, and have a hands-on experience with the technology.

Device

Thanks to Circus design, we were able to use the Eye tribe device and test the technology on an internal event.

Testing

I had a couple of initial ideas about usability testing methods that I wanted to evaluate.

  1. First Impression study / Time-out test. After looking at the page for 20 seconds, what information was the user able to digest? What captured her attention? This is an important test for every dashboard or monitoring console.
  2. Findability test. Can users quickly and easily find the information they need? Was the page visual hierarchy helpful in this task? Can they spot all the the alerts or warnings?
  3. Iconography and Semiotics. Can users understand the symbols, and how long it take them to interpret the symbols?
  4. Quantitative studies. Looking at the aggregated data from multiple users, what are the areas of most and least interest? Can we suggest visual hierarchy improvements?

Unfortunately because of technical difficulties, we were not able to prepare detailed task scenarios in advance. We simply played with the camera with my colleagues in a noisy environment and settled down with the basic time-out tests.

Results

Conclusions

Eye-tracking camera has ben proven useful technology and my team was able to recognise the benefits of the usability testing outputs. The issue with camera drivers prevented us preparing more sophisticated test scenarios in advance, but this problem could be solved with a better preparation.

We found the camera calibration to be the limiting factor for real-life use. The software was often losing the eye-gaze tracking after just subtle body movement.

Despite few drawbacks, I would recommend the device and we are now considering using the camera on real-life future usability testing.

Enterprise UX

Design stories from designing apps at large enterprise for…

Medium is an open platform where 170 million readers come to find insightful and dynamic thinking. Here, expert and undiscovered voices alike dive into the heart of any topic and bring new ideas to the surface. Learn more

Follow the writers, publications, and topics that matter to you, and you’ll see them on your homepage and in your inbox. Explore

If you have a story to tell, knowledge to share, or a perspective to offer — welcome home. It’s easy and free to post your thinking on any topic. Write on Medium

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store