Erik, I think you’re right in suggesting that we must ask new questions. However, I think the questions you propose are of a practical nature. It’s true they need to be asked and answered, but they represent typical design questions. Though they are new and reach deeper into society, they’re still only design questions. Technology has always demanded this of us.
I think there is a deeper question to tackle, one whose answer we’re not ready for. We’re about to build partial artificial organisms and someday complete ones. These organisms will ultimately be smarter, faster and stronger. They will be better in every way. The question I think we should be asking is, how can we prepare humanity for coping with our fundamentally limited natures?
It’s one thing to forget, to lie, to not be able to calculate, to not understand. It’s another to live with organisms which not only outperform us in every way but, highlight our failings with every breath we take.
This is not a technology question. I’m not sure we even have a category for it. I may not be putting it correctly, but this is the ultimate AI question humanity needs to answer.