Are you just playing devils advocate (no pun intended)? Because there seems to be a rather large creationism, abstinence only sex education, and homophobia shaped blindspot in your view. There's plenty of ostesnibly legitimate stuff that religion does to damage society without needing to do anything outright illegal (but if you need illegal, then we need only look as far as systemic child abuse in the Catholic Church). I suspect that when the OP talks about being frightened, this is the kind of thing he's thinking of. Certainly this is some of the stuff that frightens me.
Of course this is not to say that religion is all bad. I know one couple, devout members of a Christian sect, lovely people and I have great respect for them. Why? Because they walk their talk and they don't feel a need to proselytize all within earshot, trying to force others to live by the same rules they do. I assume they must realise at some level that they have no right to make such a demand. I wish more religious people were like them.