Good Product Managers Test Then Change!

What do PMs do?

Product managers are called the mini-CEO of product. In fact there are a bunch of definitions to define the role of product management. But in general, product managers are responsible for success and failure of their product. They plan for the features, they plan for the improvements, they plan for the growth, etc.

What is Testing?

The difference between a product and a project is the amount of ambiguity and uncertainty in the product. When running a project you know what is going to be delivered. The scope is well defined, the timeline is clear and you’ll deliver all the requirements at the end of a promised timeline. While in a product that you are developing for end users especially when it is a new product in the market and there isn’t many competitors or similar products in the market to take a look at what they have done, you are in an absolute uncertainty especially in the first steps. What do I mean by uncertainty? Depending on how your company thinks about the product your uncertainty level might differ. In some companies, it doesn’t matter what you build for the user (for their own reasons). They only care about delivering and developing the product. This means that end user is not in any parts of your picture. In other companies product managers listen to their users and try to create the best experience for users while solving their problems. This means that you don’t have an eye on what users might want or how they might react to your new change in the features.

  • Scope design (Knowing the goal behind the feature, regardless of being a completely new feature or a part of an older feature, defines the scope of the test. Sometimes you can’t really break something to a few steps to test and it’s not testable — which I believe everything is testable- .)
  • KPIs to be set (What should happen so that you call the test successful? What are the expectations considering the test being just an MVP?)
  • Timeframe (Based on your understanding from users and the business itself, you should define a timeframe in which the test should pass or fail. That’s because you can’t keep a test alive forever.)

What is Changing?

I believe that there is not any “the best” idea in product management. All there is, is a better idea compared to previews ideas. This is because of a lot of reasons. You’d definitely have more data and information in the future about the product, market and users so you can make better decisions. What I mean by change is that every live and working product that cares about its users is always becoming better and better. Becoming better means implementing new ideas to create a better experience and value to the users. This is the job of a product manager as mentioned above. So you need to generate ideas test them and finally decide to make the change or not. Making a change could be bringing a completely new feature to the world or improving older features. I believe:

Why should PMs test then change?

‌As said before, PMs are responsible for the failure and success of their product. This means you need to optimise everything to decrease waste. One of those things supposed to be your development efforts or in fact the human resource. We are doing tech so every ideas you have in your mind can be implemented but it needs to be developed and sometimes it takes a long time to develop some ideas. Therefore you need to be picky about what you want to develop and put into your product development cycle. Meaning that you need to test before going under the pressure of developing whole of a thing. This is why you need to test or sometimes in fact you need to run several tests before deciding to create the whole feature.

Let’s look at an example:

Let’s look at one of my startups which is a place for amateur guitarists to learn and enjoy playing guitar. Laminor is a 3 years old startup which has more than 3000 UGC guitar chords which are free for users. We have implemented a freemium model in which users can consume some of the extra functionalities or content made available to them then pay for full usage.

  1. Comparing the results after 1 week of running the test (We saw that almost all users enter their phone numbers. We were happy for the first half of the test week because everybody was entering the phone number until we saw some users being stopped in the registration step. They were from other countries and we just showed our country sample phone number as the hint in the text field. So they gave up because they thought they wouldn’t receive the message. We added another hint to make sure they are not blocked. The results were awesome because everyone was entering her phone number.)
  2. Development just began after making sure we are not making a bad experience or something users dislike.

Marketing Product Manager, Business Grwoth