So long as you have deployment automated, and frequent backups, that shouldn't be a huge issue. One of the many advantages of not having to manually deploy a new box is being able to rapidly get off a bad provider.

You can run a mostly static site on 64.

Debian minimal, with NGINX or some other light HTTP is easy on even 64 megs. On 128, you can do stuff like PHP and you can run whatever efficient web stuff you like. The web is light, if you're efficient about it.

As an aside, one of my friends has a 100 meg free VPS from one of the terrible free vps providers. He has managed to squeeze a Minecraft server on, and that can hold about 2 or 3 players! (apart from the terrible network, cpu and uptime)

It isn't (I have one, a whole $15/year due to some ridiculous sale some months ago). Consider that it's userspace only, so kernel doesn't count. I'm running a (light-duty) nodejs app, nginx to proxy it, tmux, and two irssi instances on mine right now, with memory to spare. Light PHP works fine too (haven't tried anything heavier).

A database server or similar wouldn't work, of course.

If you pay $2/month, you're a sucker; they've got lots of coupons (like the seemingly permanent 25 % discount on their website. If you look a bit further, you'll find even better discounts).