Diseconomies of scale.

The last mile of shipping is the most expensive. In the US, there are tons of last miles that are thousands of miles from very large cities.

Switzerland is a tiny country relative to the US, so it's much cheaper to deliver mail.