I can't agree with this quote enough:
"If you're mad at your client for any reason, it only means you're not charging him enough."
Tripling my cost per hour made working with one of my clients much more palatable. Please consider raising your cost if you're not happy with your clients.