> There's an argument to be made that trying to tax undesirable behaviors is a form of corruption.
Yes there certainly can. I won't make it though; I like looking at a plastic-free environment myself.
> If you want to change other peoples behavior I have trouble supporting something that unfairly penalizes the poor.
How exactly does a plastic bag ban unfairly penalize the poor?
I could make the argument that by reducing city trash and recycling costs, street sweeping costs and the store's costs in providing the bags, the poor actually benefit overall. Not to mention it's poor neighborhoods, which typically have more littering, that potentially stand to benefit more from less waste. Rich neighborhoods can afford to pay for street cleaning out of pocket if the city doesn't come through; poor ones can't.
EDIT:
When you get to the bottom of it, plastic bags impose a negative externality on taxpayers (in the form of higher city trash costs), businesses (more littering makes the city less visually appealing) and animals (which get trapped in plastic bags). People are free to use plastic bags, but there should be a cost associated with all the negative consequences of this behavior to everyone else.