IMO PaaS's aren't that expensive for a lot of projects IMO.
The only thing I use VPS's for now is testing. I just do basic security hardening and call it a day. Not really too worried if anything happens to these boxes.
I saved A LOT of time switching to PaaS's. Probably 30-40 hours a month. I don't really touch anything sysadmin related anymore and I'm a lot more productive.
I don't regret using VPS's because it forced me to learn alot of sysadmin stuff.