You are matched against the next available player. Keep giving it a go. You might need 5 points to win or 100 points. It depends.