There is a balance to be had. A reputation is an important thing, and you shouldn’t let it be ruined for trivial reasons. In many cases it is a good reputation that allows a person the freedom to do what needs to be done. We give more leeway and more resources to those who have proven their ability and good conduct, than to those who have proven their criminality and ignorance — and for good reason.
But one should not be jealous about their reputation. They should not seek to appease every person in the world, even their enemies. Right action will draw enemies.
Let one’s reputation reflect their true self, and let each person refine their true self so that it is worthy of having a good reputation. After that, be willing to give one’s own account if someone misinterprets your intentions — but apart from that let the chips fall where they may.