Member-only story
Superintelligence
The Next Challenge: Ensuring Machines that Elevate, Not Surpass
In the movie “Avengers: Age of Ultron,” Tony Stark and Bruce Banner use the scepter’s gem to build Stark’s “Ultron” global defense program. However, Ultron went rogue and turned against its creators, leading to mass destruction. The Avengers had to face numerous challenges in an attempt to stop it. This raises the question: Could superintelligent machines become a reality? If so, what might they look like, and how should we ensure they are aligned with human values?
While artificial intelligence is developing towards superintelligence, the task of ensuring these systems enhance, and do not replace, human ability is of increasing importance — an echo of Avengers: Age of Ultron. The same superintelligent AI systems capable of solving so many global problems and accelerating scientific progress introduce risks of value misalignment with humans, technological imperialism. Their planned development strategies and ethical frameworks would, in turn, be required to guide this evolution process.
What is a Superintelligent AI?
Superintelligence is an artificial intelligence system that is significantly superior to the best human cognitive abilities in almost all domains. While currently existing systems perform well in…
