QoS generally gives ISPs incentives to deliberately cause congestion by not upgrading their networks. Also, pretty much nobody is talking about customers paying for their own QoS; the idea is for Netflix to pay for it.
The only difference is in the mix and distribution of customer money flows. Some customers will be freeloading to a certain extent, others will be paying over the odds.