As someone that has transitioned, I went into it with this opinion but now on year 7 of hormones, It's more complicated. I honestly now align more with the Olympic rulings of time in the hormone ranges of what you're competing under. Where at 5 years I lost all my strength, my bone density has dropped to cis womans (dexa scans). For instance, now I work out 3 times a week, 50 pounds still feels like 'get my body totally involved' heavy, before transitioning not working out it was a non-issue kinda heavy. (transitioned at 23) So its more having the time and atrophy of those muscles gained during that time period, then all that is left is probably an advantage of having a higher rate of fast twitch muscle fibre which probably is with in variance ranges of normal genetic advantages. Which also isn't a nice message to deliver to collage athletes of you have to muscle detox for 3-5 years.
Testosterone is also an arbitrary criterion. The relevant criteria depend on the sport.
One person may have the same testosterone level as a person three times their height/weight, but that doesn't mean it's safe or fair to have them duke it out in a boxing match.
cool, cool, now you have to use heuristics to determine historic testosterone levels, or require invasive monitoring for all potential future athletes, no problems here