Easy to explain but rarely explained. People hate to lower their guard around someone whose guard is not also lowered. It’s just that simple.
You are left with a weapon they lack — sobriety.
It’s like if everyone was wearing a sidearm, and they all gave up their guns but you kept yours. I know it sounds crazy but that’s it in a nutshell.