Definitely too much ends up in landfills, no doubts about that.
However, a far higher % of returns go to landfill directly from consumers who don't know what to do with them than when its back in a retailer's hands. Retailer's processes for returns are not perfect, but they can get it back on a shelf or in the secondary markets often enough that its better than being in a consumer's home.