AI Experts Launch Data Index, Report

Initiative Hopes to Measure AI Progress

How can we quantify the value and the pace of AI and machine learning progress? How can we track all of the advances in academia, industry, and in the public sector? And what does it all mean for society and for workers? Until now, data-based metrics have been sparse and subjective.

The AI Index is a new initiative designed to add precision. It aims to track, collate, distill and visualize data relating to artificial intelligence. The Index — created as part of the Stanford 100 Year Study on AI — is an open, not-for-profit project to follow ongoing activity and progress in AI. Its mission is to “facilitate an informed conversation about AI that is grounded in data.” Ideally, it will be a “comprehensive resource of data and analysis” for policymakers, researchers, executives, journalists, and others to better understand the complex field of AI.

MIT Sloan Professor and IDE Director, Erik Brynjolfsson, is a member of the report’s steering committee along with Yoav Shoham, of Stanford University, Raymond Perrault ,of SRI International, and Jack Clark, of OpenAI.

The team has published an AI Index 2017 Report as “a starting point for the conversation about rigorously measuring activity and progress in AI in the future.” It seeks participation and collaboration from all interested parties.

In addition, an Expert Forum was created to interpret and enhance the data. Daniela Rus, Director of MIT CSAIL, is a member of this Forum along with others from industry and academia. According to Rus, “The AI index is defining intelligence tasks and measuring the performance of the most advanced AI systems for those tasks. It also provides a framework for education in AI and for grand challenges in AI.”

Download the full report here.

Read additional media coverage here and here.