I think we'll live.
We could jack the price of a stamp to $5, it would still be a reasonable price, and nobody but the stingiest of cheap people could possibly complain. If mailing something isn't worth the price of a hamburger to you, then you shouldn't be mailing that something.