Every place I've been to that surcharges credit cards also tries to do it to debit (see gas stations) so your line of reasoning there is suspect.
High fees for this stuff is the reason by so many banks changed their retail business model to things like Totally free checking(when you make 12 debit card purchases each month).