AI Is Deeply Flawed, And We Can Prove It.
New research paints AI in a new light.
Some seriously hyperbolic statements have been made about AI recently. Many leading AI figures, notably Sam Altman and Elon Musk, have stated that their AIs could be superhumanly intelligent in coming years and render huge swathes of jobs obsolete. However, recent research completely undermines this narrative. Not only does this research show that AI’s superiority is highly fragile, but it clearly demonstrates that AI is far from intelligent and, as such, has some serious weaknesses.
The paper “Can Go AIs be adversarially robust?” details this research and is a fascinating read. They used a particular type of AI known as “adversarial bots” to find and exploit flaws in AI systems, specifically the AI system KataGo, which beat the world’s best Go player. Adversarial bots are a kind of evolving AI. They are told what their goal is, typically breaking or beating another AI, and then they try to accomplish it without any actual knowledge of how to, and the AI “learns” from each failure and gets better with every iteration. In doing so, these AIs can hone in on “novel” ways to break the other AI. These researchers took an AI like this and gave it the task of beating KataGo at Go. But other adversarial bots can be used to jailbreak AIs like ChatGPT, making it produce harmful content…
