That's not really true. I don't use ad blockers, but I still care about my browser speed.
I need to experience the web day to day the same way most other people do otherwise I have a rather distorted picture of things.
As a web dev, it was blocking a lot of my CDN-hosted files to the point that I would need to work in other browser to make sure it wasn't really broken. Removing the ad-blockers restored normal function to me.
I think ad blocking days are numbered, the more mainstream it becomes the more likley the ad networks are to respond.
After that I imagine the blockers could step it up and start looking for script names, or reporting on common scripts shared accross domains, by which point we are in an arms race :)