The Key to Successful A.I.? Continual Human Intervention.
We must not accept any technology as the default solution for our problems
Algorithms do reflect the brilliance of the engineers who craft them, as well as the power of iterative processes to solve problems in novel ways. They can answer the specific questions we bring them, or even generate fascinating imitations of human creations, from songs to screenplays. But we are mistaken if we look to algorithms for direction. They are not guided by a core set of values so much as by a specific set of outcomes. They are utilitarian.
To a hammer, everything is a nail. To an A.I., everything is a computational challenge.
We must not accept any technology as the default solution for our problems. When we do, we end up trying to optimize ourselves for our machines, instead of optimizing our machines for us. Whenever people or institutions fail, we assume they are simply lacking the appropriate algorithms or upgrades.
By starting with the assumption that our problems are fixable by technology, we end up emphasizing very particular strategies. We improve the metrics that a given technology can improve, but often ignore or leave behind the sorts of problems that the technology can’t address. We move out of balance, because our money and…