You're right in saying that annoying ads are getting less common and that a minority of advertising networks have them now. I used to manually block such advertisers myself, but I gave up and started using a filter list after spending several hours trying (unsuccessfully) to block YouTube video ads.

I'd like to support the sites I visit, but the bottom line is that it's far easier to use a filter list than manually comb through the "blockable items" list in AdBlock when I discover yet another excessively annoying ad. I sometimes manually whitelist entire sites when I specifically want to support them, but frequently I don't even think about it (and when I do, I have to consider whether the ad network they're using is responsible enough to stop clients from posting ads containing Java exploits and whatnot). Using a filter list with AdBlock is one of the biggest improvements that an end-user can effect on their page load times and web browser responsiveness.