I think you touch on a big issue in modern society.
There seems to be this idea that we should all be in absolute comfort at all times.
It is basically a form of pain aversion as you imply. — The thing is we did not evolve in painless environments and our bodies and minds are not adapted to work in such a way.
Anything that is worthwhile requires pain and discomfort — oftentimes for prolonged periods of time.
Seeking comfort all the time is the trap that drug addicts fall into. It leads to short term gratification but long term dissatisfaction.
I think this is because long term happiness requires the sort of “meaning” that comes from true achievement and that is not created by taking the easy option.
If you have not read it, you may find Mark Manson’s book “The Subtle Art of Not Giving a F***”.
Don’t be put off by the title, it is actually a really well written book — one of the better non-fiction books I have read this year and I have read a lot.
If you want to find out more about it I did a review here.