That need to win and compete in human nature is the uncontrollable that could see AGI/ASI have goals that are not aligned with humans.
First, great post Ben.
Marc Kermisch

Yeah this is a big worry. The race to build AGI/ASI, I believe, is inevitable because the reward is so vast and the penalty for coming in second is huge.