First of all, I suggest you refrain from calling trans women "not women" – this is, whether you intend it to be or not, quite disrespectful. You can talk about the biological implications of being transgender without erasing their identities like that.

Second of all, there are physical changes from hormone replacement therapy. associated with transitioning. This is absolutely not "240lb judoka feeling thin on the inside" and not absurdly cut and dry like you suggest.