Only a couple of years ago the vast majority of people in the US firmly believed marijuana should remain illegalReally? In my circles, even when I lived in "red" states, the attitude was more like it's a damn shame it's illegal, and too bad there isn't a prayer of it changing.
How about gay, women or minority rights. All of them were strongly opposed by the masses.
In the 1st and 3rd case, of course, because the subject group was a minority. In the case of women, things only changed when enough of the subject group started to demand change. In the case of privacy, the subject group isn't distinct from the masses, it is everyone. So yes, it's a problem for progress until everyone gets more clued in. (It will happen, when enough bad stuff has happened.)