I do this too and I’m a small skinny guy at 5'5. I’ve got long hair, bushy muttonchops and glasses. I basically look like a hippy. So when women see me from the front they’re not scared, but I can definitely sense their fear if I’m walking behind them. This usually happens when I’m walking to or from my car at work. I find that they wear heels and have to walk at a slower space and I awkwardly pass them. I know my fast walk feels like I’m starting to invade their space until I pass by but it’s better than walking behind them for a long time.