Now there are much worse cases out there, sure. But most Swiss citizens are not even aware of those laws.
Nor are they aware of how much the Swiss government has been trying to hide its incompetence regarding anything IT-related. Like data leaks happening several times per year.
So yes, a big percentage of those almost 50% of "no we don't want this" responses were about lack of trust in the different branches of the government.
Not doing so is something the citizens can sue the government for - as opposed to US "private company can collect whatever, whenever and do whatever" (see credit ratings).
If you want some recent examples for Switzerland (beyond the dozens upon dozens the further you go back in History) look up, Verdingkinder, Swiss eugenics after 1945, Holocaust Assets (Volcker Commission Report), Post-War Forced Labor and Slaver Switzerland, Secret Police and Surveillance (Swiss Federal Parliamentary Report of 1990), etc, etc.
Some level of trust is required for a functioning society, but there are so many natural factors (human psychology, evolution, national security, crisis situations, elite capture, economic incentives, legitimizing narratives, etc.) which all lead to the abuse of power and the violation thereof that IMHO you can never limit and check it too much.
Without governmental systems, these ID approaches tend to end up in private corporate hands instead.