If the rules changed mid competition and I lost a race to someone who had been competing on a men’s varsity team and then shortly after competed on the women’s team, it would be very hard for me to just shrug and say they beat me fair and square. That reaction is not unreasonable.
It may not justify sweeping laws, but it absolutely justifies having an honest conversation about fairness.