I think that's over simplifying it a lot, obviously dysphoria and other needs come first, but you could read some Andrea Long Chu for a perspective on trans theory like that? Better than Blanchards take.

No idea on the men, though. There's certainly trans men writing gender theory but I don't think I've seen a take on male attractiveness come up in it much.