The Conundrum of Machine Learning and Cognitive Biases

Cami Rosso
2 min readJul 15, 2016

--

Machine learning is on the rise due to the technological convergence of the growth of big data, decreasing data storage costs, increasing computing power, improved artificial intelligence algorithms and acceleration of cloud computing. Machine learning is the ability for computers to learn without explicit programming. It’s analogous to the human ability to identify an octopus based on the set of data input that goes to the brain, such as eight arms, tentacles, lack of skeleton and other characteristics, without having prior knowledge of every type of cephalopod mollusk in existence.

However, human decision-making is subject to numerous cognitive biases that can easily distort judgement. For example, iconoclastic author Tom Peters highlights 159 cognitive biases that impact management decision-making [1]. Emotions such as anxiety, fear or anger could easily cloud a person’s judgement. Human thinking is prone to the use of cognitive heuristics, a shortcut that may lead to biases and faulty decisions.

Given a computer is devoid of emotion and the hubris of human ego, it would seem logical that machine learning is not impacted by cognitive bias. The caveat is that humans are creating and monitoring the programming for machine learning. The areas of cognitive bias vulnerability for machine learning include:

  • Data structure, collection and sources
  • Data set size
  • Level of objectivity in the data
  • Weight assignments to data points
  • The absence or inclusion of indicators
  • The inherent cognitive biases of the human programmer

Machine learning technology is deployed today for many business uses, including self-driving cars, online recommendation, search engines, handwriting recognition, computer vision, online ad serving, pricing, prediction of equipment failure, credit scoring, fraud detection, OCR (optical character recognition), spam filtering and many other uses. The growing ubiquity of machine learning in business makes it critical to mitigate the introduction of human cognitive biases into the machine.

Copyright © 2017 Cami Rosso All rights reserved.

References

  1. Peters, Tom. “159 Cognitive Biases Between You and Good Judgment Good Luck!” May 29, 2014.

Originally published at https://www.linkedin.com on July 15, 2016.

--

--