It strikes me that we are training AI to develop heuristics/automatic thinking, rather than what we consider high-level analytic thinking. If you’re familiar with “Think, Fast and Slow” by Daniel Kahneman — It seems like we are trying to create AI with very robust system 1 thinking. Although, it may also be the case that this is not an accurate model for how cognition works.