That is my experience as well. I would love to run an adblocker in blacklist mode and only punish the sites that annoy me, but I haven't found one that works that way. If anyone knows of one let me know.
https://github.com/gorhill/uBlock/wiki/Dynamic-filtering:-tu...
A blacklist is an interesting idea. I'd like it even better if the blacklist was only active for a limited time so that I have to manually keep re-blocking it. Then if a site cleans up their ad-act and starts running ads good enough that they don't eff up the UX I'll simply forget to re-block them.
Something along those lines might be a product, especially if you sell access to a chart of how many people are blocking your site at any time. It might be a tool that publishers can use to evaluate advertisers and not accept the business of advertisers that cause their blocking numbers to spike.