The Five Megabyte Web Developer

VPS's should offer framework specific images. A quick provision will get you Passenger/Apache/Capistrano.

At that point you basically have a Heroku-like setup up and running.

While trivial to set up yourself, it is just as trivial for the hosting company to offer the snapshot for most major frameworks.