I agree, but you have to ask yourself, what purpose do the categories serve. It seems to me that th epurpose of sex-segregated bathrooms is two-fold: (1) to make people feel more comfortable, because many have weird hangups regarding intimacy and sex, and (2) to keep women safe. Even disregarding (2), it seems to be a choice between inconveniencing a tiny proportion of the population a bit more or inconveniencing most of the population a bit less. In any case, regardless of what bathroom trans people should go in, it doesn't even remotely start to solve other issues (e.g. what bathroom does a dad take his 4-year old daughter in) which is why I think the whole idea is a huge politically-motivated strawman.