Evaluating ML Opportunities, Part 2

James Kotecki
Dec 12, 2019 · 4 min read
Image for post
Image for post
Who doesn’t love some juicy low-hanging fruit? Photo by Marina Khrapova on Unsplash

This is the second in a three-part series laying out questions you should ask before you start a machine learning project.

After you’ve answered ‘yes’ to the prerequisite questions we covered in Part 1, it’s time to ask the next set of questions. This time, you’ll take a harder look at your project idea.

Think of these questions as guidance for your own intuition. If enough of the answers make you feel uneasy, you might consider if another project makes more sense.

Does the Project Actually Matter?

If your project succeeds, how will it help you decease costs or increase revenue? And how confident are you that you can actually achieve real business impact beyond a nifty “science experiment” that winds up on a shelf?

Will this project address an issue that is of major concern to you, your C-suite, or someone else that matters? Will the project solve a significant pain point, or is it simply a “nice to have”?

The expected impact of a project might naturally evolve over time. As you proceed, your expectations will become more refined. But even after you start a project, you need to keep asking if it actually matters.

Can the Project Scale?

“Science experiments” that only work in certain conditions and have no chance to impact the broader organization are not a good use of machine learning resources. To butcher the old proverb about a tree: if a machine learning project goes into production and almost nobody knows about it, does it make an impact? Probably not.

You want to give more weight to machine learning projects that have a potential to end big. But this doesn’t mean you should start with your ML intensity set to maximum. It can be smart to start small.

Is This Low-Hanging Fruit?

This advice may seem inconsistent with the desire to pursue projects that can scale and have real impact. What I’m really talking about here is the order in which you proceed. Impact at scale should always be the overall strategic goal, but doing easier projects first can build the internal momentum that allows you ultimately to achieve that impact. Plus, some ideas may be able to scale precisely because they are simple.

Especially if there’s a potential shortage of C-level support for significant change, it’s a good idea to go after the simplest thing first and prove that it works, rather than trying to shoot for the moon and failing. Even the original moonshot — Apollo 11 — only occurred after other missions had paved the way.

You won’t always get to pick low-hanging fruit, of course, either because you already picked it or the situation calls for reaching higher up the tree.

Can You Break the Project Up into Smaller Pieces?

You could try your first ML initiative as a pilot project. This gives you the chance to conserve resources while you build support and learn lessons that will be valuable if you follow it up with a larger-scale endeavor. It could also be a way to deliberately create some of the low-hanging fruit we mentioned above.

Again, it’s good to have a project that can ultimately scale for maximum impact. But to get there tactically, it’s good to start small so that you can end big.

Do You Understand How It Works?

Ask how the technology is actually going to work. Could a human do this task before? If not, how will a piece of technology do it?

Are You Properly Calibrating Expectations Given the Hype?

Machine learning can help your business do incredible things. But when you hear fantastic promises, it’s your responsibility to align your expectations to the messy realities of day-to-day business, not the perfect conditions of a machine learning lab.

If all of these questions leave you ready for more, it’s time to jump into the final stage of the evaluation: process questions. Those are up next.

James Kotecki is the Director of Marketing & Communications at Infinia ML, a team of data scientists, engineers, and business experts putting machine learning to work.

Machine Learning in Practice

Practical insights for executives, managers, and project…

James Kotecki

Written by

VP of Marketing & Communications for Infinia ML, a machine learning company. Speaker from North Carolina to South Korea.

Machine Learning in Practice

Practical insights for executives, managers, and project managers eager to deploy machine learning inside their company.

James Kotecki

Written by

VP of Marketing & Communications for Infinia ML, a machine learning company. Speaker from North Carolina to South Korea.

Machine Learning in Practice

Practical insights for executives, managers, and project managers eager to deploy machine learning inside their company.

Medium is an open platform where 170 million readers come to find insightful and dynamic thinking. Here, expert and undiscovered voices alike dive into the heart of any topic and bring new ideas to the surface. Learn more

Follow the writers, publications, and topics that matter to you, and you’ll see them on your homepage and in your inbox. Explore

If you have a story to tell, knowledge to share, or a perspective to offer — welcome home. It’s easy and free to post your thinking on any topic. Write on Medium

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store