Chargebacks are frequently last resorts for dealing with unscrupulous businesses or places that just don't give a shit once they've sold you what they want to sell you.
That said, chargebacks can also be used vindictively and/or fraudulently. And Visa/MC/etc could do a better job in dispute handling.
One major root of the problem is the liability shift from police to the cards and banks. If you're a buyer, you're suppose to file a chargeback, not call the police. If you're the merchant, you're suppose to contest the chargeback, not call the police. In a real sense, it's legalized theft enabled by a card ecosystem sustained by companies with a monopoly that make too much. To think the law favors these companies more than the people is outright disgusting.
If you as a merchant get an invalid chargeback, you can report the buyer to the police.
And for most people it's not worth trying to lift a pack of donuts off a store shelf, but if they do they get arrested and can end up with life in prison where there are three strikes laws. That's what keep the police busy and the prisons full. Credit card fraud is far more common, and usually the perpetrators are not desperate, are mentally well, intelligent and intentional -- far more deserving of punishment if that's what we're after.