"So, your average female sporter would probably blow you away in most contests then."

This is irrelevant. In track and field, elite to sub-elite high school boys beat all women ever in the sprints and field events, and even in longer distances the best US high school boys beat the women's world records. In basketball, for instance, the difference is even greater because height makes a big difference -- in fact, D1 women's basketball programs apparently bring in men who are semi-serious intramural basketball players to get better competition in practice.