Yes assuming you never want to work or live in the US, compared to a Swiss passport and a handful of other passports that's true. Compared to 90% of countries on the planet, it's not true.
>the IRS issue is a real problem in a country where the median salary is just under 85k$ per year (no need to be a rich guy).
How many dual US and Swiss citizens are making under under or anywhere near the median income? It's very hard to migrate to Switzerland, so my guess is not many.