To what extent can we trust Algorithmic Decisions

NAGRA Insight Team
Jan 31 · 7 min read

At a time when humans are becoming more reliant on AI — speech recognition on our mobile phones, real-time speech translation, computer vision used to develop self-driving cars — trust and transparency have become key issues to be addressed as these systems are scaled and implemented on a global scale: their black-box nature means that we can’t entirely trust the validity of their outputs, especially with regard to the manner in which they arrived at their decisions.

Among the academic experts working on this issue is Adrian Weller, Programme Director for Artificial Intelligence at the Alan Turing Institute where he is also a Turing Fellow leading a group on Fairness, Transparency and Privacy. He is also a senior research fellow at the Leverhulme Centre for the Future of Intelligence where he leads work on Trust and Transparency. The article below discusses the issues he brought up during a talk on Trust and Transparency at the Data Science Summer School at Ecole Polytechnique, Paris.

  • Algorithmic stock-market trading: this provides a liquid market which works very well but, left to run their course, also gives us Flash Crashes (e.g. May 2010).
Figure 1. An example of adversarial example applied to GoogLeNet. Adding an imperceptably small and carefully selected vector to the initial image changes GoogLeNet’s predicted outcome to ‘Gibbon’ with very high certainty
Figure 2: Putting strips of black tape on a stop sign changed the output of the model from “Stop sign” to “Speed limit 45”
Figure 3: Example of a bad algorithm which misclassifies a husky as a wolf due to the snow in the background
  • Version 2 (request with a real reason): “Excuse me, I have 5 pages. May I use the Xerox machine, because I’m in a rush?”
  • Version 3 (request with a fake reason): “Excuse me, I have 5 pages. May I use the Xerox machine, because I have to make copies?”
Results of the Copy Machine Study (Langer, 1978)

NAGRAInsight

We are TV specialists, data scientists and engineers, part of the Kudelski Group. We help content distributors drive their business using data.

NAGRA Insight Team

Written by

Feel free to reach out: insight@nagra.com

NAGRAInsight

We are TV specialists, data scientists and engineers, part of the Kudelski Group. We help content distributors drive their business using data.