Demystifying UX analytics: why data is essential for design success

Antonio Arévalo
John Lewis Design
Published in
5 min readSep 12, 2023

As an Experience Design Manager at John Lewis, I am passionate about seeing beyond the data and using data to inform what behaviours we see, understand where the frictions are, and quantify the impact our design changes might have and why.

I have made it my mission to share my love for UX analytics within our John Lewis design community by championing the value of UX analytics within our design processes.

In this post, I want to demystify UX analytics and share my learnings of why data is essential for design success.

What is UX analytics?

UX analytics is the process of collecting and analysing data about how users interact with your product. It involves using tools like heat maps, user surveys, and A/B testing to measure user behaviour and identify pain points in the user experience.

What makes UX analytics different from guesswork is that it provides objective data that can be quantified and analysed. Using UX analytics, designers and product teams can make data-driven decisions and test hypotheses to optimise their design. Without analytics, design decisions may be based on assumptions or personal opinions rather than on the needs and behaviours of users.

Overall, UX analytics is a critical component of the design process that enables designers to create experiences that meet the needs of their users and deliver business results.

Diagram showing UX analytics at the the intersect between what users do and the data we collect
UX analytics : the intersection where human behaviours meet the data we collect

Addressing misconceptions about UX analytics

One common misconception about UX analytics is that it is too complicated or time-consuming. However, there are many tools and resources available that make it easy to integrate UX analytics into your product development process.

Having said that, giving our teams analytical tools is not enough. We must provide our teams with the right conditions to build confidence and thrive using these tools successfully.

This is why I made it my mission to create a UX analytics “upskilling programme” for our designer that goes beyond onboarding. By creating tool kits, running “upskilling” workshops and boot camps, having drop-in sessions and sharing your learning with other team members, we are starting to see a step change in our relationship with data within our design community.

The importance of UX analytics in design

UX analytics is essential because it helps you understand your users, what they do, and why they do it. It also enables you to measure their user experience and find pain points in “as-is” journeys/designs.

To effectively use UX analytics, designers must clearly understand what they are measuring and why. They should also be aware of any limitations or biases in the data they are collecting and use multiple data sources to cross-validate their findings. Incorporating UX analytics into the design process requires a commitment to ongoing monitoring and analysis.

Ultimately, UX analytics is a valuable tool for designers looking to create user-centred designs that meet the needs and expectations of their target audience. By leveraging the power of data, designers can improve the user experience and create products that users will love.

Examples of UX analytics tools

There are numerous tools and techniques available that can provide invaluable insights into user behaviour and design performance. Combining these UX analytics tools can help designers gather a wealth of information about their users and their behaviour.

It’s important to note that while these tools are helpful, they should not replace direct user feedback. At John Lewis, designers are supported by a team of UX researchers who are great at working with the team and choosing the right methods to give us the best qualitative insights.

Here are some of the most popular UX analytics tools:

A trump card of five analytic tools.
UX analytical tool trump cards

The benefits and best practices of UX analytics

The benefits of using UX analytics are numerous.

At John Lewis, UX analytics is helping our product teams to drive cross-functional, user-centred conversations that avoid wasting time and resources on ineffective solutions. By relying on data rather than assumptions, our designers (and team) are making more informed decisions that are more likely to lead to successful outcomes.

Designers are more involved in driving analysis throughout their design process, supporting the teams in validating pain points, qualifying the value of investing time and effort in the problem at hand, and understanding “the why” something is or isn’t working behind our A/B tests.

Now that we understand the importance of UX analytics in our design process, it’s crucial to implement them correctly.

Here is my suggestion on what your “UX analytics best practices” roadmap should look like:

A diagram detaling a UX analytics best practice roadmap
UX analytics best practice roadmap

To conclude, here’s why I love bringing UX analytics into our design process

  1. You don’t rely on guesswork and assumptions. Instead, I use UX analytics to make informed decisions that, over time, help us create products that your users will love.
  2. UX analytics is a powerful tool that can help design and product teams create successful products and user experiences. By collecting and analysing data about user behaviour, you can identify pain points and develop solutions that address your users’ needs.
  3. UX analytics in your design process may seem daunting at first, but it’s essential for creating successful products that meet user needs. Work with your team to follow best practices to get started and keep your data-driven design process on track.
  4. Without UX analytics, you may be designing for yourself rather than your users. By collecting data about how users interact with your product, you can gain insights into what’s working well and what needs improvement. This can lead to a better user experience and increased customer satisfaction.

--

--

Antonio Arévalo
John Lewis Design

App Experience Design Manager at John Lewis and Partners