What you said makes me wonder about a totally different way of using a metric of how likely the person is to win a given match.

That is, perhaps the system could be engineered to maintain a more even win/loss ratio so that people don't go on super-long win (or loss) streaks in general by adjusting who they get matched with.

It probably wouldn't work that well towards the edges, but around the middle it might work well enough.