Image for post
Image for post
image credit: https://www.ontotext.com/knowledgehub/fundamentals/what-is-inference/

Why you should read this post

Deploying machine learning models to production in order to perform inference, i.e. predict results on new data points, has proved to be a confusing and risky area of engineering.

Many projects fail to make the transition from the lab to production, partially because these difficulties are not addressed on time.

In my opinion, there are three major factors which make deployment challenging:

  1. Starting the process late — Partially due to cultural gaps, and partially due to the nature of the research cycle, many teams leave the subject of deployment till very late in the game, resulting in an array of nasty surprises and challenges. …


credit: https://www.google.com/url?sa=i&url=https%3A%2F%2Fwww.mobihealthnews.com%2Fcontent%2Fgoogle-researchers-use-deep-lear
credit: https://www.google.com/url?sa=i&url=https%3A%2F%2Fwww.mobihealthnews.com%2Fcontent%2Fgoogle-researchers-use-deep-lear

Google Health’s recent paper provides a fresh set of insights about what it takes to bring an AI solution to real clinical use. Below is a summary of some key takeaways which should be applicable to many companies and solutions in this space

Introduction

for the last few years, Google Health has been making headlines over its AI based solution for detecting diabetic retinopathy (and diabetic macular edema) from retinal fundus images. The latest episode of their journey covers a post-development phase of clinical deployments, and a prospective study combined with a “human centered evaluation” of their solution.

Having worked on commercial AI-based solutions for healthcare (radiology and more) for a number of years, I find that these publications resonate deeply with my own experience and learning. …


Why ML needs its own flavour of dev. methodology and a partial, draft proposal for such a methodology

TL;DR

  • ML teams working on complex projects need to battle the intrinsic challenges in ML, as well as the friction which arises from their multi-disciplinary nature which makes it hard to make decisions.
    A solid Development Methodology can help teams improve execution.
  • ML is different from standard software in its level of uncertainty, as well as the fact that models are influenced indirectly — and not engineered by design.
  • Agile doesn’t work out of the box for ML despite being a useful mindset — For example, it assumes that small features can be built by design and plan with low risk which doesn’t work for…


… But ML teams need to overcome a big cultural gap

Over the last few years, many software organisations have started developing products which leverage machine learning.

Like every new technology, ML involves a certain learning curve, and managing this learning curve is critical for a successful ML adoption.

Interestingly, many organisations focus so much on the areas they need to learn, that they miss the opportunities to leverage assets they already have, which are critical for their success.

A great example of this phenomenon is the “Data Science Unicorn” myth.

The “Data Science Unicorn” myth

Some companies expect to hire a single data scientist, who will deliver their ML project practically single handedly.

This person is a “Data Science unicorn” — a mythical being who can magically execute a Data Science project on her…

About

Assaf Pinhasi

Machine Learning and Engineering Leader and consultant. https://www.linkedin.com/in/assafpinhasi

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store