Before you leave the car, do you just leave your trash on the seat or something? Certainly a bag or receptacle is desirable for food waste at the very minimum, and you don't want to gunk up your cupholders or door pockets with such things.
Being in the car for a few hours with an exposed banana peel isn't the greatest, regardless of what happens to it at the destination.