Webfaction. $5 shared hosting on Nginx servers, very nice, clean system. SSH access to mess around and have fun.

I run a rock solid suite of Wordpress sites and have nothing but GREAT things to say about the experience.