This will make little apps -- restaurants, dance studios, newsletters -- insanely easy to build and deploy.

I doubt it will do much for bigger ones, though. Scalability, performance and QOS are matters of system administration -- precisely the matters that Heroku takes out of your hands.