Assholes gonna be assholes. You shouldn’t lose sleep over it. They harass you is to provoke this kind distress to undermine your effectiveness, ‘cuz Lord knows if they have to talk issues they got nuthin’. At least if you expect it you won’t be surprised.
In this early phase of your “ascendancy” (flattery, perhaps, but relatively speaking, still true) people are going to hit you hardest to try to establish a false characterization about you or drive you out of the conversation. The only solution is to push on through the BS. We got your back and we’re out there defending you as well. But time is on your side, as long as we keep moving forwards.