Until you're spending the salary of a large fraction of your engineers on hosting costs, there are much bigger things to worry about than hosting costs. AWS is user friendly and a lot of engineers are familiar with it, so developer productivity is strongly in its favor.

Also, you know what you're getting security-wise with AWS, and no one will blame you when your website / service goes down because AWS is down.