I've never had a problem, and I suspect it's more likely to be shared hosting which ends up getting blacklisted due to people installing insecure scripts.

If you use a half-decent provider who quickly investigates any unusual traffic on their network then I can't see it being a problem.