Algorithms work better than doctors

Oded Ran
Oded Ran
May 23, 2012 · 2 min read

I came across this fantastic paper after reading about Meehl’s 1954 book, “Clinical vs. Statistical Prediction: A Theoretical Analysis and a Review of the Evidence”. It’s a meta-analysis (review of studies) of the evidence that mechanical prediction techniques like fixed questionnaires or algorithm generate superior predictions compared with those made by clinicians, regardless of their level of expertise.

In plain words, it suggests that simple questionnaires and algorithms arrive in more accurate predictions compared with clinicians, doctors or psychologists. I can’t believe this is not mandatory reading in every university.

The abstract:

The process of making judgments and decisions requires a method for combining data. To compare the accuracy of clinical and mechanical (formal, statistical) data-combination techniques, we performed a meta-analysis on studies of human health and behavior. On average, mechanical-prediction techniques were about 10% more accurate than clinical predictions. Depending on the specific analysis, mechanical prediction substantially outperformed clinical prediction in 33%-47% of studies examined. Although clinical predictions were often as accurate as mechanical predictions, in only a few studies (6%-16%) were they substantially more accurate. Superiority for mechanical-prediction techniques was consistent, regardless of the judgment task, type of judges, judges’ amounts of experience, or the types of data being combined. Clinical predictions performed relatively less well when predictors included clinical interview data. These data indicate that mechanical predictions of human behaviors are equal or superior to clinical prediction methods for a wide range of circumstances.

The full article is available here:

Oded Ran

Personal blog of Oded Ran, covering technology, startups…

Welcome to a place where words matter. On Medium, smart voices and original ideas take center stage - with no ads in sight. Watch

Follow all the topics you care about, and we’ll deliver the best stories for you to your homepage and inbox. Explore

Get unlimited access to the best stories on Medium — and support writers while you’re at it. Just $5/month. Upgrade

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store