The Pros & Cons Of Product Pilots

How to successfully pilot your products and avoid wasting time, money and leads

Adi Shmorak
The Startup
5 min readAug 13, 2019

--

Photo by Cristina Gottardi on Unsplash

So, you finally have a shiny new product (or maybe just a squeaky MVP). Nonetheless, It is time to take it out for a spin. Doing a pilot with real live customers is not a game of chance but a well-thought-out business tactic. In this story, I will cover everything (almost) you need to consider before, during and after the pilot.

Why Pilot?

Considering the Why is always good for you. Ask yourself, “Why should I pilot my product?” and closely examine your reply. There can be countless answers to that, but only a few are valid. Here are some examples of valid reasons to go on a pilot.

  1. My customer requires it before making a substantial commitment
  2. I need to get some social validation for my product from a reputable source
  3. Regulations require it (like FDA or similar, applicable only in certain domains and territories)
  4. I need to test out some product or market assumptions that require real customer interaction

Once you know your reasoning, you can start planning out your pilot. This should come before an actual pilot opportunity is available, but in many cases, you get the opportunity to pilot before you even think about it seriously. If that is the case, first find your why and start planning. Say yes only if the opportunity meets your goals and planning.

“The difference between successful people and really successful people is that really successful people say no to almost everything.”

Warren Buffett

Planning a Pilot

Once you know your Why, planning should revolve around it passionately, if not obsessively. You have a goal and need to make sure you reach it. Pilots tend to go off rails even when planned, but planning helps reduce the risk and improve readiness for when the $[-]!7 hits the fan. Planning should include, but not limited to:

Goals are direct derivatives of your Why. Don’t get creative. If your reasoning is valid, phrase it as your goal (e.g. get a customer order).

KPIs are the quantified measures of your goals. Simply drill further down from your Why and goals. (e.g. minimum 100K$ order)

Time Frame Should be as short as possible yet long enough to reach your set goals. One-year pilots are an Oxymoron (except in MedTech and other unique cases).

Target Audience should be well defined, based on your goals. If you want social validation, choose a thought leader, not a laggard.

Owners are not only the people in your organization who are in charge of the pilot, but your partners should also name someone from their end to lead the pilot to success. Nominating for these roles, IMHO is the single most critical ingredient for success. Without an owner, things fall between the cracks, and there is no one to celebrate the success or watch out for bumps along the way (and there are always such bumps). Now is a good time to mention that if your pilot partner is not interested in nominating an owner for the pilot, it’s because there is no real interest in your product (and the pilot's success). Be warned!

Marketing should have a say while planning. Whether you want to take pictures or gather testimonials, marketing should be involved in planning and probably during the execution. Using a pilot to create marketing assets is something to consider, regardless of your goals.

Pre/Post refers to any activity that takes place before and after the pilot, usually to ensure the pilot succeeds and that everybody can see that. Such activities include collecting data (through surveys, product analytics, etc.), sanity checks, training, intro webinars, etc.

A roadmap is not just a product thing. When piloting, putting everything on a timeline is a good practice. From pre-activities through mid-pilot and post-activities, mention any way-point and actions needed to take you from one way-point to the next. If you choose to add sub-tasks, define owners and put everything in a project management tool, you have everything you need to manage this pilot like a pro, except for a project manager, which can be nominated.

Execution

Once the pilot starts, make sure to keep your eyes on your goals. It is not unlikely that even though you planned everything, things will go off the rails. Maybe the time frame no longer fits, or owners tend to neglect their responsibilities. Whatever that may be, you must focus everyone on the set goals. Make sure you get what you came for. There is no concrete advice I can share here (but feel free to add in the comments), as every pilot is unique, but as long as the pilot answers your Why you should be fine.

Conclusion

After the dust has settled, you should have everything you came for: a big fat order, testimonials from thought leaders, product/market insights or anything else your business needs to grow. Make sure you cover the following:

Communicate the results within your company and possibly with your market/customers/investors etc. Internally, you should also refer to the pilot's good, bad and ugly sides. It is a good example to share failures and mistakes as part of doing/trying/accomplishing.

Celebrating is not just making a toast for a pilot done well (and recognizing the people who contributed). It also involves the related PR, marketing assets, publications, blog posts and whatever you can do to celebrate and monetize this. Whether social validation was one of your goals or not, a success story is always good (and sometimes, even a bust story can be just as good).

Implement what you have learned. Maybe there was some valid feedback from the customer, or the pilot planning could have been done better. Maybe there are more questions to ask (and another pilot??). Regardless of the outcome, growing means becoming a better version of your former self. Whether it’s you we are talking about, your product, team or company, make sure the pilot drives improvement.

Too often, I encounter pilots with no realistic time frame, no well-defined goals, and no mechanism to ensure it’s a success. Whatever you do, do not go on a pilot on a whim, hoping it will go great and end in a big, profitable, repeatable transaction.

It won’t!

Need some help planning your pilot? Let’s Talk

This post has been published on www.productschool.com communities.

--

--

Adi Shmorak
The Startup

I'm A Product/Market Fit Detective. Like Sherlock Holmes, I employ Backward Thinking to solve P/MF. Get my guide at Https://adidacta.gumroad.com/l/4steps2pmf/