Empathy is not pure perception. Seeing something from another persons point view involves putting yourself in their shoes entirely. If this does not influence you then what you are currently doing is not empathy.
As for the devils of history: some clearly have lacked empathy, but many others have had it. It just wasn’t the overwhelming motivating factor for them, in whatever situation they were in.