Atheists and agnostics don't get together every week to talk about God not existing.
There are meetup groups and such now but usually there is some common interest, activity, etc. which is a higher barrier to entry than "I'll come and say we mostly believe in the same thing that neither of us can prove."
A church community does have the unique characteristic that anyone can participate regardless of age, personality, or talent.
Many churches still have little to no female clergy. Some have dress codes, some don't. And what you have to choose from depends on where you live: They all might be pretty conservative.
Your barrier of entry is set too low. It isn't that we say we mostly believe in the same thing: It is that you must act like you believe it and not be any of these sorts of people. If you don't fit in the mold, you can't be yourself here. This makes it a bit difficult to form bonds with others if you aren't in their mold.