Norah Vincent basically broke her psyche trying to live as a man, and the story has barely left an impact on the status quo. Similar stories exist among transmen rather than women going incognito, even if in their case it would be to pick their poison.
The idea that there are no downsides doesn't mesh with reality.