That is generally how it works when people don't accept obvious resolutions. If you want to challenge its obviousness be my guest. It is pretty normal for a DnD/board game group to be meeting at someone's house where there is literally only one bathroom. It is hard to miss the fact that both genders can use it without complaint.

In a sporting context or similar where people are needing to change clothes then it isn't an easy one, but in this context it isn't much of a challenge.