A Simple Take on Measuring AI Progress

Philip Dhingra
Sep 4, 2018 · 2 min read
Image for post
Image for post

The way futurists tell it, AGI (Artificial General Intelligence) is either around the corner or never going to happen. Part of the problem with predicting AI progress is that AI is hard to quantify. It’s not like CPU progress, which we can approximate using Moore’s Law. Ray Kurzweil attempted to use Moore’s Law, though, to extrapolate AI gains and predict we’d have approximated human brains by 2020. But that extrapolation assumes that having the processing power required to perform a complex task is all that’s needed to perform a complex task. That’s just not true. AI progress requires both software and hardware progress.

Since we can’t measure AI in terms of gigahertz, it might make sense to take a hybrid approach. Perhaps we can measure AI progress in terms of cognitive accomplishment, as well as the size of that accomplishment’s associated hardware. For example, the size of Deep Blue, which is the computer that beat the world chess champion Kasparov in 1997, was about the size of a filing cabinet. Meanwhile, the chess-playing module inside of our brain is maybe the size of a pea. The volume ratio between a pea and a filing cabinet is perhaps 1:50,000, which means that the AI for playing chess had roughly one-fifty-thousandth the efficiency of the human brain. However, within a decade, cell phones had enough processing power to play world-class chess.

Likewise, the size of Siri or Alexa today may take up an entire data center, which is about 1,000 filing cabinets, whereas our brain’s language processing center (Wernicke’s component and the Broca region) is around the size of a walnut. In a decade, it’s possible that Siri or Alexa could exist inside a small module on our phones.

In the future, computer scientists will attempt to approximate the neocortex, which is the part of the brain associated with our high-level cognitive features, including emotional intelligence. The volume of the neocortex is perhaps the size of a tennis ball. It might take the whole world’s processing power today to approximate one human’s neocortex. But eventually, the computational needs will come down to the size of a data center, then a filing cabinet, and then ultimately a chip that could fit in the palm of our hands. Such an AI would likely be the final AI, as the neocortex is the part of the brain that enabled us to form complex social relationships which are the soil that yielded our complex civilization and AI in the first place.


Complete essays from Philosophistry: The Love of Rhetoric

Medium is an open platform where 170 million readers come to find insightful and dynamic thinking. Here, expert and undiscovered voices alike dive into the heart of any topic and bring new ideas to the surface. Learn more

Follow the writers, publications, and topics that matter to you, and you’ll see them on your homepage and in your inbox. Explore

If you have a story to tell, knowledge to share, or a perspective to offer — welcome home. It’s easy and free to post your thinking on any topic. Write on Medium

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store