Heroku is pretty good at getting you from zero to deployed cloud app, but it does have a lot of limitations, and their pricing gets pretty painful as soon as you scale. Transitioning to running directly on AWS is not easy.
I’d encourage you to consider a cloud computing framework that lets you deploy with the most cost-competitive provider, and gives more flexibility in exactly what resources you pay for. Something based on Docker? I’m not an expert here.