The right and obvious solution is to make special accommodations for people with special needs.
The only right way is to give equal treatment to everyone.
Everyone is entitled to enter a restroom or no one is. I can get behind that. No more multi-toilet rooms with stall gaps.
Your version of equality is worthless, your backbone is just an excuse to make yourself feel better.