This story is unavailable.

I don’t think this conclusion is solid. It might be only quite a small cost to have other goals, and the environment may well have other evolutionary pressures which push against the value-copying goal. For example other agents may differentially prefer agents who are pro-social or hold other complex values, and create enough of a gradient to select for this rather than Y.

Show your support

Clapping shows how much you appreciated Owen CB’s story.