If you follow that line of reasoning to its extreme logical conclusion, you might arrive at a completely nonsensical argument that former rapists should be allowed to join rape victim support groups.
If someone wants to make an argument about equality, one needs to also consider the concept of a safe haven. If a specific type of people are a threat to the safety and well being of a community, the community should have the option to disallow that type of people altogether without being subject to "social justice" pedantry. Condominiums can bar entry to homeless people on the grounds of vandalism prevention and that's perfectly legal and accepted. I don't see how this is much different.