Lonely town

I got myself into a restaurant to eat alone. Somehow I got a little anxious about what people would think of me. 
“Look at him, so lonely” “I rather kill myself to eat alone” thoughts come to me. 
Why is so bad? Why I felt like I was doing something wrong? It’s not me, it’s the paradigm of dealing with yourself.