I think people grossly exaggerate this. We have libel and slander laws. Individual companies aside, entire communities of people aren't that stupid. In my opinion, this is a really pessimistic view of people and also not based in reality in my experience.
At the end of the day, we need to be able to listen to victims. The amount of fake accusers compared to real victims is microscopic.
"And people who are accused are damned, period."
Not really. There are literally countless examples of accusations/allegations and nothing happening to people for whatever reason, usually influence/popularity.