Everybody's paying for this, it doesn't matter if you hustle or if you don't, if you have a card or not. Contracts prohibit merchants to charge more than cash so they need to cover the processing fee by increasing the prices paid by all. It's not like they can refuse to accept cards.
It's one of the larger rackets in the economy today, whole percentage points of consumer spending is syphoned by the financial industry as pure rent.