That might sound obvious, but it works and it's easy to setup. I left Posterous after they launched Spaces and went back to hosting my own Wordpress install. I host about 20 low traffic sites on a single Bluehost.com shared server that costs under $100 per year. Never had any issues. One click Wordpress install via SimpleScripts. It really doesn't get any easier.
Hosting companies come and go, do whatever they please with your data.
Nothing like having as much control as possible.
Sadly this is not possible for non-technical users.
My first regularly updated site in 96 was updated by hand; then I created a daily news site that was custom-roll; then I moved to Movable Type; then I custom-rolled again; somewhere in there I tried Drupal (for a year or so, not just a dalliance); then I used whatever RoR blogging engine was popular; then I got real and moved to Wordpress several years ago and haven't regretted it for more than a couple seconds, here and there. And those seconds of regret were more than made up for by the lack of crap I had to do myself. (And, naturally, nobody can shut MY wordpress blog down since I ran it on my own server and now WPEngine.)