This is silly for a bunch of reasons, not the least of which is that there are already "weight classes" for many sports as a way to have different body types compete on a more equal playing field. Perhaps dividing competitors by gender is arbitrary, but all game rules are arbitrary.
If we want to remove gender from the equation, perhaps we should have "testosterone classes" where athletes compete against others with a similar testosterone level.