Dream11— How did I discover the major usability issues in the Dream11 app?

Sandeep Parashar
May 4, 2018 · 9 min read
Image for post
Image for post
Dream11 — Android App Screens

About Dream11

Dream11 is India’s Biggest Sports Gaming platform with 20 Million users playing fantasy cricket, football, kabaddi and basketball. Dream11 is a game of skill that offers Indian sports fans a platform to showcase their sports knowledge. Fans can create their teams of actual players from upcoming matches, score points based on their on-field performance and compete with other fans.


Background

Recently, I was in discussion with @Harsh Jain — Co-founder & CEO of Dream11 regarding his revolutionary product and the million $ business model. During our discussion, my 1st question was him to “How did you crack this business model?” He laughed and explained to me about, how it all started. He also explained how Dream11 team value their users and their experience, that is the reason users always come to their top priority.

Well the purpose of our discussion was, he wanted me if I could invest my time to help in identifying the most critical problems on their application and how those can be solved to make the users journey more easy and playful.

I accepted this initiative because 20 million users are associated with this product and if I could solve even 1 single critical problem that would directly impact on the millions. Well, I decided to invest my time for doing a usability analysis on their Android application and prepare a valuable detailed report to share with Dream11 team to take action on the recommendations.


Why Usability Analysis?

The purpose of doing usability analysis is to identify usability problems, collect quantitative data on participants’ performance, as well as determine user satisfaction.

If the product is difficult to navigate or doesn’t clearly articulate a purpose, users will leave. Making it so they don’t leave, makes usability analysis a necessary task.


Methods Used

I used 2 methods to accomplish this task those are as following:

Image for post
Image for post
Usability Analysis Methods
  1. Expert Review:
    An expert review is a cost-efficient way to identify major usability problems. Instead of requiring several weeks for finding users, running the tests and writing up a report, an expert review can be completed in less than a week. The expert review conducts by a usability analyst who points out problems and provides recommendations based on his extensive experience and in-depth knowledge of usability principles. The expert review can save a lot of money by making the product easier to use and fulfilling the user’s expectations.

Usability Principles

Following usability principles I followed during this exercise:

  1. Efficiency:
    - Efficacy:
    Accommodate a user’s continuous advancement in
    knowledge and skill.
    - User Control: Make users the initiators of actions rather than the
    responders to increase the users’ sense that they are in charge of
    the system.

Targeted Users for Usability Testing

There are 4 users I approached, those were close to the target audience/personas of this product to perform summative usability testing exercise is as follows:

Image for post
Image for post

Task Scenario:

Usability testing is a task-driven exercise, where the usability analyst narrates a scenario to the tester to help him to get into that situation to perform the given task.

Scenario: Assume that recently you came to know about Dream11 application from one of your friend. He explained how you can earn money by following your passion & utilising your cricket knowledge using this application.

Task to perform:

1. Install Dream11 android app on your mobile.

2. Create your best cricket team.

3. Play & Earn.

Instructions:

Instructions are mandatory for the 1st time users those are not familiar to the usability testing exercise to avoid unexpected behaviours and fulfil the purpose.

Do’s:

  • Please, think-aloud whatever thoughts are coming to your mind while performing this task.

Don’ts:

  • Facilitator/observer won’t help you in this task. Because in the real scenario there is no one will help the user as well.

Usability Testing Insights (Video Recording)

I have captured the following ratings based on the user’s testing experience and post-task interview questions.

Image for post
Image for post
Overall Rating — 3.6 out of 10
Usability Testing — Recorded Video

User ‘Ravi Saxena’ has taken more than 12 minutes to accomplish a task, and not able to convince to pay for joining a contest.

Due to the following reasons:

  • He was unable to identify what has to perform and how?

Discovered 5 Critical Problems

I discovered 5 critical problems during this process, those undoubtedly might be impacting on the users’ retention OR increasing the chance of huge drop-offs.

Problem #1:

Bad discoverability and installation hassles:
Unfortunately, this app is not available on the Google play store due to some reasons. Users have only option to install Android version from the Dream11 mobile site. The discovery of application and the installation process through the mobile site is a difficult and painful task for the users. (screens/flow below)

Image for post
Image for post
Android App — Installation Flow

Recommendation:

The mobile site can be converted into a fully Progressive app until Google allows Android version on the play store. The progressive app can cover the entire range of mobile clients/versions, no installation would be required and no discovery hassles at all.


Problem #2:

Registration option on the 1st screen seems unreasonable/illogical for the new users, who have not yet experienced the product or convinced from it. Such options can lead to major drop-off.

Prediction:

“Skip for now” option would be the 1st choice of the maximum number of new users due to the above reasons.

Image for post
Image for post
Android App — Onboarding Screen

Recommendation:

Since registration is not mandatory for creating a team, this option can be asked purposefully before making the payment and not for creating a team or a joining a contest. This will surely remove the barrier for the users those want to experience the product 1st.


Problem #3 (most critical):

The entire information architecture, visual representation and the basic usability factors are not matching users’ expectations.

Few Examples:

  • Header Sequential navigation is failed to explain users about the game.
    Select Match > Create Team > Contests Joined?
Image for post
Image for post
Android App — Match Selection Screen

Recommendation:

The entire information architecture of the screen needs to improvise. The language should be user-centric and match to users mental model. Pre and regular usability testing sessions will ensure the acceptance ratio of predefined usability factors.


Problem #4 (most critical):

This screen is the most important step of the game/flow and the most difficult step for the users to accomplish the task. Curious why? here are the reasons:

Reasons:

  • The very 1st time when users experience this screen, the 1st question comes to their mind. What has to do here?.
Image for post
Image for post
Android Application — Create a Team

Recommendation:

Hierarchical multi-level navigation structure can solve 2 steps problem. Regarding the visual representation of item selections/indicators, the product design system (visual assets, and patterns) needs to define.


Problem #5 (most critical):

Join contest: This screen looks like a marketplace of contests with endless options. No system intelligence has been built here for the beginner OR mature users/players. High cognitive and visual load, which can lead users to some random selections OR in case of frustration can lead to drop-offs OR delete the application after investing a lot of time.

Image for post
Image for post
Android Application — Join Contest Screen

Recommendation:

System intelligence can be built on this screen for handling a various range of users e.g. beginner, intermediate or advanced by their need, understanding or behaviour.


Let’s Come to the Conclusion

The number of problems I could identify can be solved easily to avoid users dissatisfaction and make them stick with the product for a longer period. The action items are as following:

  • Usability factors need to define and validate through regular interaction with users and testing sessions.

Thank you for reading :-)

If you liked this case study, please give me some claps so more people can see this post. Thanks! 👏

If you have any feedback, I’d love to hear from you. You can also connect with me on LinkedIn.

Welcome to a place where words matter. On Medium, smart voices and original ideas take center stage - with no ads in sight. Watch
Follow all the topics you care about, and we’ll deliver the best stories for you to your homepage and inbox. Explore
Get unlimited access to the best stories on Medium — and support writers while you’re at it. Just $5/month. Upgrade

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store