For me the keys are security & reliability. Most home made solutions score pretty bad on those two points.
For the providers, OVH, Digital Ocean or Linode are good for me when renting servers. Despite the weird names (see: https://www.expeditedssl.com/aws-in-plain-english, for a version in plain english), Amazon provides an incredible level of service with very few hiccups. A lot of PaaS such as Heroku are actually built on top of AWS (and so is Netflix for example).