Update: Ghostery appears to outperform Disconnect even when both are put in "block all trackers" mode [4].
[1] http://www.areweprivateyet.com
[2] http://cyberlaw.stanford.edu/blog/2011/09/tracking-trackers-...
[3] https://github.com/ghostery/areweprivateyet
[4] https://github.com/gorhill/httpswitchboard/wiki/Comparative-...
https://github.com/gorhill/httpswitchboard/wiki/Comparative-...
Ghostery does a better job than Disconnect.
I believe this was appropriately accounted for. "Ghostery and Disconnect were set in their respective equivalent of 'Block all trackers' mode."
https://github.com/gorhill/httpswitchboard/wiki/Comparative-...
I just re-installed all of them, and now I find they are all easier than ever to set up at install time. I had to tamper with Disconnect defaults months ago when I installed it, just like Ghostery and ABP. I appreciate it's no longer required.
If I adopt your arbitrary rule it would be pointless to do comparative measurements of privacy protecting power. I rather click once on a button at install time in a wizard (ABP, Ghostery) to be able to perform meaningful measurements than having to adopt a nonsensical methodology which would provide no useful information to end users.
Rather than dismiss the results, I think you should reproduce it and make a diff to find out what Disconnect doesn't block, and see how it can be improved. Maybe I will work toward finding more about this in the next benchmark.
https://easylist-downloads.adblockplus.org/easyprivacy.txt
Also addons like requestpolicy and self destructing cookies are beneficial.