Sounds like the matchmaking needs to factor in the standard deviation of the players' skill, like a Sharpe ratio for skill.