The Full Chess Cheating Report of Hans Neiman
chess.com
chess.com
The report also reveals Niemann's engine move correlations alongside over two dozen chess Grandmasters who have admitted to cheating on chess.com. The fact that online cheating is so widespread even among top chess players is certainly news to many, including me. Perhaps it is a good thing that this scandal is highlighting the issue, and given how widespread cheating may be, perhaps chess tournaments both online and physical need to take cheating much more seriously than they apparently have been.
There is also an interesting analysis of Hans' rating improvement history, his over the board tournament performance and key game analysis, and a rundown of key moments in his game against Carlsen in the Sinquefield cup. Each raises concerns.
Chess.com's report also makes it clear that Niemann lied outright about his history of cheating in post-Sinquefield interviews, as he admits in communications with chess.com Fairplay staff to much broader cheating.
All in all, the report raises many concerns and it seems reasonable for the chess community to demand much higher standards of cheat prevention and detection across competitive venues. How long might cheating issues have gone on merely rumored vs fully investigated or acted upon, had this intrigue not developed due to Carlsen's withdrawal from Sinquefield '22?
[1]Tangentially, this induces an obvious concern about cheat and cheat-detection arms races. A clever cheater might scrutinize this report and refine their cheating plan. For example, they might recognize the need to use a second device (such as a phone) to cheat. They might use the data corpus presented in this report to establish limits on how often they use chess engine moves per game, and they might manage their ratings progress over time carefully, so as to stay in acceptable ranges of engine move correlation, rate of improvement, etc.
But even with all the evidence presented, "proof" is a tricky thing. To what standard would we be trying to prove a claim?
Does this report prove beyond all reasonable doubt that Niemann cheated? I'd say no, but others may disagree.
How about to a preponderance of evidence? Perhaps. But even that is hard to say when no one has yet presented a rigorous defense or set of counterpoints.
In any case, my post wasn't meant to say that Niemann cheated per se. I have no idea, and chess.com themselves may not be able to actually prove whether he did. But I found the report interesting, even beyond the current issue surrounding Niemann and speaking to potential cheating in high-level chess more broadly, and if you re-read my post, I tried not to state anything definitive about whether Hans actually cheated or not.
2) Quite often there are certain "play lines" that computers will play that humans simply can't find over the board.
For example, a computer can take a defensive "play line" that is littered with traps with only a single non-losing path for 30+ moves and work it out really quickly (there is only one non-losing path to take so it prunes the search space mega fast) and play it perfectly. A human playing such a line is almost always cheating--humans simply can't run those kinds of lines in real time.
If you look at computers analyzing even the highest end games, you see the humans making quite a few mistakes that the computers will spot and take advantage of immediately. Someone who walks down these kinds of paths regularly is a statistical anomaly.
That having been said, given the current crop of computer-trained chess kids, it IS possible that we'll grow a prodigy that can run those kinds of lines. However, it doesn't seem like that person exists, yet.
Are you sure? I’ve never heard of such a program.
E.g. if you initiate a queen trade in a straightforward position, on the next move I have to take back my queen; any other move will show a gigantic evaluation drop by the engine. But that doesn’t mean it’s a particular strong move — even an absolute beginner will play it. Thus it’s of no value for determining whether the person who played it is cheating.
It’s entirely possible that chess.com has access to more sophisticated software that can estimate the strength of players (they sort of allude to this with their “strength score” metric) but AFAIK it’s not publicly available and not clear how it works, or whether it can evaluate individual moves as opposed to the game as a whole.
In Go, we can't make ourselves spread our moves around the board as much as we should, we tend not to choose a maybe good move elsewhere over a clearly powerful move where the board is developed, for example.
Maybe there's a pattern to the moves AI chooses that is also a pattern humans can see without running every line; we're just reluctant to choose moves that we can't clearly justify in the shorter run.
It probably doesn't, and for many reasons, both because the more engines you add the greater the chance of falsely accusing someone (so an analysis that features hundreds engines is probably worthless), but worse than that, you can manipulate the result of the analysis through the selection of engines
There's a number of topics about that on /r/chess, like https://www.reddit.com/r/chess/comments/xtwzfe/fm_ingvar_joh... https://www.reddit.com/r/chess/comments/xtwzfe/fm_ingvar_joh... etc
But anyway this isn't the analysis that Chess.com does anyway
This is video explains it pretty well, and seems like a very compelling argument (at least to me): https://www.youtube.com/watch?v=qjtbXxA8Fcc - and just know that the woman talking is a bit hard to understand because of her accent.
... oh, and to address your point about 100's of engines, my first thought was that are only a handful that everyone uses (Stockfish?) (and also, just guessing, but I get the impression that most top engines recommend similar moves, but again, just a guess!).
... also, not sure I agree with his opinion that for each move that is analyzed, LetsCheck will return 100% if any engine returns 100% (and there could be multiple computers that were used, each with different engines). The point of the analysis is to determine if a player is playing like a computer, and the user may himself have multiple chess engines open in order to confuse the cheat detection. But again, am not an expert at chess engines or statistics, so am not sure what effects checking multiple engines has...
... also, he says that "Ken Regan's scientifically valid method has exonerated Hans by saying his results do not show any statistically valid evidence of cheating." This is very confusing, because Chess.com post has basically said the opposite (maybe Ken Regan's analysis is referring to a different subset of games?). Guess nothing is definitive. But at this point, I still lean towards Hans cheating (on top of this analysis, there is also a lot of circumstantial things he did that to me indicate he might have cheated, which is too long a topic to go into).
What it mostly shows is that Hans move strength is unnatural.
Further evidence to support this is that he often plays bad moves. That is, moves that are considered blunders, with a high frequency. This is either an attempt to cover up the engine moves or representative of his actual capability. For instance, the report mentions that in a post-game analysis he suggested a move that would be an obvious blunder. When the interviewer pointed this out, Hans wasn't fully convinced until he was shown the engine analysis. So he also is showing a habit of deferring to what the engine suggests.
Not to me. When the stakes of winning are so damn valuable, sometimes literally so, it would be patently stupid to not cheat and increase your odds of winning.
Remember: Cheating is only a problem if you're caught. If you're never caught, cheating is completely legitimate.
These aren't games of pleasure, played for the sake of playing chess. These are games played for the sake of winning. Prize money, ELO, fame and renown, etc. When the only thing that matters is winning, you gain nothing by playing honestly.
Am I playing chess because I love chess? To have fun? In that case, cheating is counter to my goals (unless I enjoy the act of cheating itelf, but that's getting besides the point).
On the other hand, is chess simply a means to an end? Am I playing chess because I want to win something? If so, cheating is but one of many possible decisions I can undertake to increase my odds of winning.
Where professional games are concerned, where money and fame are at stake if you lose, cheating is downright inevitable and certainly not something to be surprised about.
I am implying that because that's inevitable in a situation where winning is so much more important than simply playing. Again, these aren't games of pleasure, games "for fun". These are games with valuable stakes on the table.
Even Magnus himself can be argued as playing to win in order to eventually obtain the famed 2800 ELO or whatever the magic threshold number is. If evidence comes out that Magnus cheats, it would be a shame but I wouldn't be surprised either.
In situations where the ends justify the means, the means will include cheating.
The cop does better in his job by meeting his quota of speeding tickets, so it objectively makes sense that he would issue you a speeding ticket every day with no evidence and over your strenuous objections... except you wouldn't object because the cop is working the system rationally. Yeah, right. Anyway, the lawyer you hired to work through this issue in court would of course inflate the number of hours he worked on your case, because why wouldn't he, he'd be an idiot not to!
Can't wait for you to apply for you YC investment, you make a great business partner, so rational and all.
Human society and life isn't one of cooperation and harmony, it's a competition and we're all striving to one up each other to varying degrees. If that involves literally kicking another guy off the ladder, so be it. If a cop is feeling particularly irate and/or is hard pressed to satisfy a quota with frivolous speeding tickets, so be it. Contractors inflating their hours is par for the course.
Life ain't all sunshine and flowers, it's also dirty and ruthless. Nobody's a saint in this plane of existence.
Totally unfair. Some of us succeed by being dealt unreasonably good hands at birth.
You also fail to understand I'm not passing judgment on such behaviour. Rather, I'm saying we need to take into account the ruthless nature of reality if we don't want to get screwed over ourselves.
Calling evidence of Neiman cheating a surprise is an honest and naive understanding of reality, one which leaves you wide open to cheating thrown your way that you will never realize because you never expect it.
Nobody is a saint, much less when achieving victory is so heavily incentivized as in professional games.
That's a total non-sequitur. Perhaps no-one is perfect (though frankly I doubt it), but that doesn't mean that cheating more means more success than cheating less.
Cheats definitely exist. But many of them end up doing worse than people who live more honestly, as we see here.
However, for serious real life situations where stakes are high, risk of ruin is too high. This is not rational. In fact, those stars have to align for the cheater, not the honest ones.
(I still don't think Hans cheated OTB and chess.com is being ridiculous)
It's just a different way of saying that when the measure of something becomes the target, then that measurement is gamed.
Would you also assume that Goodhart (https://en.wikipedia.org/wiki/Goodhart's_law) prefers cops who issue illegitimate tickets, or lawyers who pad their hours?
Yes, many can square this circle in their own heads and convince themselves that anything goes. Some, like Lance Armstrong, will enrich themselves enormously. But none of them will have “won”.
Once a set of rules are defined, competitions and tournaments within those rules are meant to determine the best people in that game.
When a player cheats, and rationalizes it as "only matters if you get caught", that means the cheater is playing by different sets of rules from his opponent. They are playing literally different games. If the two opponents are playing different games, it completely undermines the purpose of the competition.
Therefore, if a player cheats but is never caught, he isn't a cheater. If a player isn't a cheater, whatever he did is legitimate and it isn't a problem.
Therefore: Cheating is only a problem if you're caught.
Put another way, the rules only tell you there will be consequences if you are caught breaking them. The rules do not and cannot police the act of cheating itself, only the results of such actions and only if the act of cheating becomes known.
So the optimal way to play a game to win is always to play skillfully /and also/ cheat without getting caught. Not cheating is not optimal to winning. It is absolutely a high risk, high return course of action, but that's the nature of optimizing.
But entering into the competition under the guise of legitimate play means you also care about the prestige of being declared the winner. But you haven't won the game. You've played a completely different game. You can claim to have played the same game, but that would be a lie. You could just as easily redefine "narcissistic sociopath" in your own head to exclude adhering to The Rules. But it'd still be a lie.
I see in your other comments in this thread that you claim "most people finish dead last in life", intimating that they are fools for not cheating. But that's the thing: if everyone cheated, it would be a complete breakdown of society. Rules, laws, and systems to enforce them, are how we can leave our houses in the morning without wearing bulletproof armor from head to toe.
But what do I know? I only have a happy life with my wife and two kids. I'm a loser. So go! Cheat at science and get that Nobel Prize money! Cheat at keeping your restaurant clean and pocket the savings on soap! Never mind the wasted time and resources and lives ruined. You're a winner.
I made no such claim. I stated that, quote: "... Honest people finish dead last in the race known as life."
>if everyone cheated, it would be a complete breakdown of society.
Human society has always been, always is, and always will be rife with cheaters of varying degrees and impact. Some will be caught, most won't be.
Also, if you expect a game to bring profits in a long run, risk assessment may become too complex, if you can be caught retrospectively (like that top-score trackmania guy for example). Some people understand it from the beginning and decide to not put themselves into an unstable trap for life, even if cheating is compatible with their values.
You’re right that games (businesses, situations) themselves may have a long-term model which includes cheating as an optimal solution. But assuming that people playing it are all cheating sociopaths is incorrect. Tbh, your persistence all over this subthread is a sign that you have some sort of a close personal relationship with this topic.
I consider it like "thief". A thief is a thief when they thieve. A cheater is a cheat when they cheat.
I don't agree with blanket statements like that but I think there's a kernel of truth in your mindset that many people are oblivious to.
Chess, as a competitive game with meaningful stakes, is obsolete. It became obsolete when the first computer outplayed the reigning human champion, and it's been gradually becoming more obvious. Recent events have started to demonstrate precisely why: people are becoming better at cheating at chess way faster than they're getting better at playing chess.
100% disagree.
Legitimate would mean condoning cheating. Which then means everyone should be allowed to use engines, which then would mean engine vs engine, which we already have.
Human vs human no augmentation.
If you can't prove a player cheated, that is if you never catch the cheater, then whatever the player did is legitimate. It doesn't matter if the player in fact cheated and got away with it, it's all legitimate if he wasn't caught.
The rules do not and cannot police the act of cheating itself, only the results and only if the cheater is caught.
A cheater is a cheater even if no one knows it.
I guess it comes down to: does objective truth exist, or is everything relative to society's beliefs?
For the purposes of this discussion, I define "legitimate" as whether anyone wants to cry foul on a player's performance. If a player cheats but doesn't get caught, it's legitimate because nobody can cry foul and make it into a problem.
>As another thought experiment, what if someone didn't cheat, but society erroneously came to the conclusion that the person did cheat. Is what that player did legitimate?
Nope.
>I guess it comes down to: does objective truth exist, or is everything relative to society's beliefs?
If we were to drill down to it, it can be argued humans can never truly be objective. Take Neiman for example; so far we haven't seen any evidence (that I'm aware of) that Neiman did cheat in his game with Magnus without any doubt, but it appears that society at large has decided that he was a cheater in that game.
This and the aforementioned thought experiment actually also come back to one of my original arguments: That not cheating is stupid. When you can be judged a cheater despite being honest, or judged honest despite being a cheater, it is much more beneficial to just cheat and attempt to reap the rewards of cheating. Being honest gains you nothing while burdening the risk of losing everything, while cheating potentially gains you more at the risk of losing everything.
Also, I hope you don't misunderstand any of this as me passing judgment one way or another on this sort of behaviour. Personally, I would prefer no cheating, but there are my own thoughts and then there is reality, and reality is as filled with sunshine and flowers as it is dirty and ruthless. I see all this as a great opportunity to appreciate reality for what it truly is, so we hopefully don't end up on the short end of a stick insofar as what's within our powers to affect.
Hans cheated in over 100 online chess matches, and now he's stuck in this giant controversy. If he didn't cheat in those matches, none of this controversy would have happened, and he would be judged based on his skill.
The people who succeed cheat only as far as to reap the rewards while avoiding the risks thereof, they pick the time and place to cheat and not cheat. Of course, we don't know as third-parties whether any such successful individuals are in fact cheaters or not since nobody caught them.
To put it another way, if Neiman cheated in over 100 online chess matches and nobody caught him, we wouldn't know he's a cheater and we would judge him based off his apparent "skill". Thus, cheating is only a problem if you're caught.
1. Getting caught and problems arising from that
As you stated, there is a non-zero chance that someone who cheated will get away with it. And there is a non-zero chance that someone who didn't cheat will be wrongly widely accused of cheating. But someone who cheats has a much much higher chance of being widely accused of cheating that someone who doesn't. Cheating purely increases your chance of being widely accused of cheating.
You as a single individual cannot know all the various analyses that will be done on your games in the future (whether analysis of your moves vs engine moves or analysis of video or data recordings from websites you're on). You cannot foresee all the different possible ways you might be caught. The better you get, the more analysis will be done on your past games. Every past cheating instance is a liability for the future.
And if you rely on the cheating to get to a high level, you'll be forced to continue doing it to retain that level. You can't foresee the various anti-cheat mechanisms that will be put in place in the future that will catch your future cheating.
Once you're caught, it's basically disaster for you. Even when you don't cheat in the future, people will still suspect that you're cheating.
2. A feeling of accomplishment
People are often motivated by a feeling of accomplishment. If you're cheating to get ahead, you're not accomplishing as much, so you won't have as much of a feeling of accomplishment. If you use a cheat code to beat a videogame you don't feel much accomplishment. You won't feel like the best person in the world at chess if you only won due to a computer feeding you moves.
3. Enjoyment of a better world
You said you'd personally prefer a world without cheating. By not cheating you would be helping create that world. By cheating you would be helping to create a cheatful world. You're going to have a hard time advocating for a cheat-free world if you yourself are cheating due to the conflict of interest. E.g. you won't be able to advocate for installation of anti-cheat protections because if they get installed, they'll catch you. Same with advocating for stronger statistical analyses.
If you cheat, you're disrespecting the people around you, both your competitors and the audience. When you're consistently disrespecting everyone around you, I would expect that to have a negative impact on your ability to make friends with them. It could negatively affect your mood and your outlook on life. Overall I expect your life to be less enjoyable.
4. Morality
Is there objective morality? Do we have a moral obligation to respect other people? What is the meaning of life?
I say yes there is objective morality. Yes we have a moral obligation to respect other people, it's one of the components of the purpose of our lives.
> it's all legitimate if he wasn't caught.
> The rules do not and cannot police the act of cheating itself
These statements alone, well sure.... everything is legitimate if it's not caught. That's by definition.
Are you arguing really hard for the definition of word legitimate?
I'm actually quite confused about what it is that you're arguing here from these statements.
Going back to my comment I have issue with:
> cheating is completely legitimate.
Which is not what you're saying here.
[Edit]
If you made your statement that "the world is a dirty place" I think most would agree with you. The point almost every reply is taking issue with is when you say "cheating is legitimate".
The replies, including my own, are saying "cheating is not acceptable". By originally saying "cheating is legitimate" you are saying "cheating is acceptable", but in your follow up arguments it's "cheating moves that are not caught are considered legitimate", which is the definition of legitimate and thusly there's no substance.
Important point I'd say. I really can't shake my personal feeling that chess as a sport is just simply dead, especially as an online e-sport. Especially in combination with the possibility that there's plenty more cheating that they're not catching/detecting.
Taking this report along with Hans's admission to only cheating twice, for example, and accepting Chess.com's assessment as accurate, it would seem that Hans's mistake was to confess only to the instances of cheating that he thought had been caught. Which indicates the mentality and experience involved where the actual game is not getting caught and many, just as Hans was before beating Magnus, are playing it successfully.
Online chess is bigger than ever, and some kind of botting/cheating is possible for virtually every e-sport (indeed I'd say many are easier than chess). This is a major scandal that should have serious consequences, but there's no reason for it to be the end of online chess.
That being said, if it turns out that online chess continues to do well, but there's still plenty of cheating going on, I don't think it'd be accurate to say online chess is alive because it wouldn't be chess but something different, for better or worse. And whether such an outcome occurs might be what's really at stake here.
https://chess24.com/tour/standings/ (Prelim standings / Knockout Bracket).
Online chess is alive and well.
The whole "so many top players caught cheating" is a bit much. None of the very best are cheating.
I think it's the other way, chess is about as easy to cheat as it gets. With chess you can have a perfectly usable cheating system that isn't on the same computer at all - computer A is clean, and is where you actually play on chess.com, computer B is where you enter the moves into the chess engine. That doesn't work for something like CS:GO or League of Legends or whatever, cheating or botting needs to be in real-time and on the same computer.
Strategy games may be harder, but still not going to take too long before those exist.
(Very similar to how you might detect chess cheaters, actually.)
It’s doable to get around kernel detection tools.
The number of people who can build that kind of system from scratch is small.
But anyone can cheat at chess online.
https://coral.ai/models/object-detection/
Which you can buy as a USB stick for $59:
https://coral.ai/products/accelerator/
Sure, it's a little more complex if you want to train on specific heads as opposed to a generic model, but not hugely so. The biggest challenge would likely be downsampling the video stream into something the model can process quickly enough.
A weekend project were you have to design an ultra low-latency software + hardware stack, a custom mouse and train a custom AI. I would be incredible if anyone manages this in a weekend.
I agree it's still tough though, most I/O paths on generic hardware will have buffers at every step that you'll have to fight to eliminate.
Humans regularly manage to hit heads without that reaction time, and a human will still be involved in the aiming / predicting where to aim.
However a human sees the enemy BEFORE it enters the crosshair and estimates and corrects when the enemy will enter the crosshair. A trigger bot measure exactly WHEN the head is in the crosshair, it has no predictive power of enemy dynamics. This totally changes the latency game. A 150ms trigger latency from the time a head is in the crosshair basically means you shoot when either the crosshair or enemy has moved significant amounts. This also means that you can very obviously cheat with a trigger bot if you use the trigger badly, the human needs to "hide" the trigger latency to make it appear human. You can't compare it to human reaction time at all, a trigger needs to be about an order of magnitude faster to be useable.
This sounds exactly like the old “Twitter would be easy to implement give me a month” naivety.
Development is hard, even small projects aren’t usually finished in a weekend, let alone something there’s no reference implementation for and that we’re merely speculating about.
If such a project was built in a weekend to work reliably enough others could use it successfully in gameplay, it would be highly impressive. Maybe we’d call it an extraordinary effort, if for no other reason “because software”.
I can do the code and place the esp32 in a mouse on a Saturday (my C is always rusty, not using it professionally). And I am a hobbyist at best. So the original serial mouse/keyboard are connected to ESP32 that normally proxies the signal of the hand movement to the PC.
If I press a pedal (w/ foot) the second computer would receive a signal, calculate a human alike trajectory to move the mouse and send it to the ES32. The latter will execute it along with the left click to shoot.
Like I said - trivial. The same can be done with the USB port as well, and it's not harder. Just that for PS/2 I have the tools laying around.
Latency _could_ make it a lot more difficult, but beating a human I don't expect would be hard.
You don't need to do hundreds of fps. Just grab the newest frame, process it, repeat. Missing frames at most increases effective latency or means your cheat isn't 100% effective if you miss a head. It's a sliding scale of improvements, not a deal breaker.
You also don't even necessarily have to process the whole frame. Just the bit actually _at_ the crosshairs is probably going to be enough for a crappy version.
And a fake mouse is just usb-hid, usb gadget whatever search terms, not like you'd have to break any new ground there.
I consider it a "weekend project" because it's just throwing together a couple of existing libraries in a fairly standard way. Like most things, cleaning it up enough to be perfect could/would take far longer.
Fishermen Team Accused of Cheating by Stuffing Fish With Weights https://www.si.com/extra-mustard/2022/10/01/fishermen-team-a...
If there is a way to cheat, someone will inevitably give it a go with enough incentives. Cheating is the meta-sport and I would think no sport could ever be completely free of it.
The big money tournaments like bill fish, where millions of dollars can change hands, are usually catch and release on the spot but entrants have a judge on board to measure any fish caught.
I've done competitive king fishing in the past, and cheating or suspicion of cheating has been around for decades.
And the rest! I'm pretty crap (hovering 750-850 on chess.com, idk if I play enough for it to be accurate though, probably lower) but I was still thoroughly impressed when I got thrashed by someone (~1200) playing the entire game in their head. As in I had a local game running on my phone, called out my moves, entered his, and he never saw the board, just held it in his head. Thrashed me.
(And there was background conversation going he'd occasionally chime into, ordering pizzas, etc. Ridiculous.)
Starcraft is about the only e-sport where I can see tournament cheating providing a very large advantage for a single bit of information - a player who can be notified that he is being all-inned would have a huge advantage in tournament play.
It would also be a lot harder to detect since just having a hunch is a perfectly valid reason to jump into the fog.
If you or your team is capable of making a tiny chess computer that fits under your skin and can go undetectable, then congratulations to you.
So basically a bit like Formula-1.
I'm sure it'd be highly illegal.
This sent me musing whether we are actually witnessing the emergence of a new type of gamesmanship. If we don't end up killing each other in another global war (sadly there won't be subsequent volumes about "the war no one wanted"), then having men and machines team up in competitive environments is a given. (This is already happening, no doubt, in military settings.)
Maybe new games can be devised, or existing games modified, that can't default to games that are machine vs machine with the human teammates reduced to secretaries in the game. Games designed with AI teammate already in mind. The human role can't be just physical. I wonder what that would be like.
So, again, even though some statement from chess.com was expected, this one probably does more harm than good. Heavy implications, winking and chuckling, but nothing that would allow one to close the case (quite naturally). All of this historical progress evaluation was done by people a month ago already, and did achieve as much as this one. This one is "official" though, so pours another barrel of fuel into the fire.
That said, I wonder why 15 minute (or even more) delay isn't standard in events like that. Seems like the least you could do, given how questionable chess in 2022 is in the first place.
Someone should organize that running joke: naked chess tournament.
There's a video of Hikaru Nakamura looking at some of the games identified by this report, and he was admitting that it wasn't immediately obvious to him: the games looked like good games (although I didn't watch the whole video).
So such a test of the system almost feels necessary for the chess world to see if they really can tell the difference between high level classical OTB play and cheating. It would be interesting indeed if ever the consensus was that a fair player was the cheater and the actual cheater just looked like "good play"!
I also agree that Hans material drop in performance after the broadcast delay could be reasonably attributed to:
1. he's 19 2. the best chess player in the world said he's a dirty cheater
Such circumstances would throw off many prodigal 19 year old's, I'm sure his emotions got in the way of his playing. (I also believe he was cheating here, but I don't think the drop in his performance meets any standard for acceptable evidence)
I kind of suspect magnus misplayed because he knew that Hans cheated so much online.
This exists in every domain, and is - perhaps - inevitable. Look at what SEO has done to web search.
It's no different, since we have no control over Google's ranking mechanism and they won't explicitly tell you what the algorithm is (and change the rules daily), so it's just guesswork.
Baffling an entire colossal "industry" is built from guesswork.
And actually this tallies quite well with my experience of amateur physical sport, where at the lower levels everyone's honest and sporting and it's all great fun, but as soon as you get to the point where people are putting their heart and soul into the game, everyone's cheating, everyone knows everyone else is cheating, and anyone who's not cheating might as well give up and go home, as far as winning things is concerned.
Once you put money on it, and you're playing against people you're never likely to meet in real life, Jesus I can't imagine what it's like.
if you have ADHD you are naturally a cheater! or if you have some important reason to check your email periodically.
same applies to online tests of various sorts.
A few weeks ago my daughter very proudly announced that she managed to "outsmart" (=hack) her online test app used by her class. I was shocked and asked why she would do that, she's smart enough to get an A without that. She seemed obviously puzzled by my question and my lack of enthusiasm about her "achievement" she was so proud of (it involved some JS modifications). I guess is it's just another kind of thrill.
When you’re bored you try to learn how the system works - it’s a valuable skill.
I wonder if maybe it was the chance to solve a different challenge than the one before her (the test), which if she could already get an A maybe wasn't the right challenge?
chess.com globally has more than 93M members. There is cheating, but a dozen admissions can't be accurately described as "so widespread." Research has shown fewer than 0.02% cheat. While this is mildly shocking, your statement based on 12 grandmaster admissions is a sweeping generalization.
This is how many grandmasters admitted cheating, not how many players globally have admitted it.
As of 2021 there were 1,315 active grandmasters. [0]
24/1,315 = ~1.8% of grandmasters admit cheating (give or take a few depending on how many play online chess or are still active). In my opinion, that is a serious problem.
[0] https://chessdelta.com/how-many-chess-grandmasters-are-there...
> As of 2021
This is a tough number to track down, and you've limited the count by "active," in 2021, but the number is rapidly increasing. According to the FIFA Database as of a few moments ago, there are 1771 chess grandmasters.[1]
24/1771 < 1.4%
> In my opinion, that is a serious problem.
Even assuming 1.8% of chess grandmasters are cheaters, this means that 98.2% of them are not. If you tested a 98.2% of a perfect score on a test, would you really think your grade was a serious problem? If you had the chance to retake the test for a replacement score, either better or worse, would you?
[1] https://ratings.fide.com/advaction.phtml?idcode=&name=&title...
Yes, I think cheating more than a fraction of a percent as you originally posited is a detriment to competition.
The difference between 1.8% and 1.4% is negligible and is only in regards to the limited population of chess grandmasters which could not be a valid sample representation of 93M chess.com members.
> Yes, I think cheating more than a fraction of a percent as you originally posited is a detriment to competition.
Your answer is apparently in reply to some question that was not asked. On the contrary, my claim was that the argument that cheating was "widespread," by extrapolating a mere two dozen cheaters among 93M, is fallacious reasoning, specifically a sweeping generalization, and also that
>>> Research has shown fewer than 0.02% cheat.
which is not a postulation but a published fact.[1] Being that two hundredths of a percent may be described as a tiny fraction of a percent rather than more than a fraction of a percent, you can clearly see in this case, by your own scrutiny and straw man, cheating is not a detriment to competition.
[1] https://www.chess.com/article/view/online-chess-cheating
They conclude that while there are several unusual things about his OTB play, there is not enough for them to conclude he probably cheated.
Basically the biggest takeaway here is that he definitely publicly lied about the extent of his cheating prior to his original ban.
> While that statement may seem discouraging, it has been borne out in modern chess.
> Greats like Fischer, Kasparov, Carlsen, and almost all of the modern GMs who have been established as top five players, were notable GMs by age 15 at the latest
Wow.
It doesn't really matter, does it? There's a big difference between telling someone "if you're not a GM by age 14 [but actually I mean 15], then don't bother, it's hopeless" and "a typical top-level player reaches GM by age 14, but it is possible to reach that level even if you are a relatively 'late bloomer'." I'd prefer not to err on the side of telling people not to try.
Well, it's a report about cheating which is essentially claiming that if you're not a GM by age 14, then you must be cheating. Which is...kind of the same thing.
The conclusion of their report is repeated several times; no evidence of OTB cheating.
I don't think any serious commenters are going to complain about the absence of stereotypes about "the greats" unbacked by statistical analysis. That is what is bad. The actual analysis of anomalously fast progress at equivalent ages is fine.
It's literally the single most important fact in this context.
If there are lots of people like Aronian, then there's nothing out of the ordinary about the evolution of Hans Neiman as a player. If he's a rare and unusual example, he shouldn't be cited to suggest Hans' skill growth is within the norm.
>I'd prefer not to err on the side of telling people not to try.
This is a non-sequitur.
Almost by definition the exception disproves the rule.
There’s literally no logical sense in which the exception can prove the rule unless the rule is not really a rule but more of a suggestion.
https://en.wikipedia.org/wiki/Exception_that_proves_the_rule
It honestly doesn't bother me as much as when people incorrectly say "begs the question" when they mean "raises the question" but I think we're long past the point of us ever correcting any of these.
This is confusing correlation and causation.
One thing that people don't realize is the sheer amount of money required to become a "GM". You have to get a certain number of "norms" from FIDE and the requirements list is a PITA: https://chessgoals.com/how-to-get-a-grandmaster-norm/
If you don't have a lot of money and a lot of free time to go to a lot of chess tournaments around the world, you are not getting a "GM" title in this day and age. This favors children (few time constraints) with rich parents (lots of coaching along with the ability to travel).
The problem is that if you aren't a "chess prodigy" by 15 it generally isn't worth continuing to pursue--what does sinking the resources into being a "GM" get you at the end? If you're one of the "Chess Gods", you have entry into the tournaments anyway, and, if you're not, it doesn't really matter.
It’s an absolutely ridiculous basis to make a claim.
Hans Niemann was almost 17 years old when the pandemic started. When he turned 15 (June 2018) his rating was 2313, almost 200 points (an immense gulf at that level) below the minimum to become a grandmaster.
I find this true for any semi-competitive endeavor that doesn't also have intrinsic extra benefits. You're going to hit the people who want it more than you and are willing to put in the practice time, and they're going to beat you.
Consequently, any competitive thing I do has to also have an extra dimension to it. A competitive sport is generally fine since I'm getting in better shape. I'm happy to do stuff like darts or bowling if it has a high social aspect to it. As long as I can be slightly above average and that's good enough and there is some extra benefit, I'm down with it.
Chess, sadly, generally fulfills none of those criteria.
!
You even managed a double-entendre in 2 completely different realms. Well done.
Anand, a former world champion, became a GM at age 19 and is still ranked World No. 9 currently (at age 52). Ding Liren (Current No. 2) became a GM at 17. Grischuk (currently No. 17, peak No.3) became a GM at 17. All three have crossed 2800 ELO at some point.
I hope this is not the sort of analysis that chess.com has run in the other 71 pages of the report.
Even the graphs look a lot like copy-paste jobs from excel, which is fine obviously, but not the sort of thing I'd expect competent scientists/data-scientists/developers to be doing, especially for a big public report where some of the formatting issues are just about readability and basic presentation quality. Like Figures F and G (page 14) ... why are they styled so differently? Same question applies to many of the graphs, which isn't to mention label font sizes either.
Beyond that, yea I'd say good amounts of the data and logic are pretty basic and wouldn't be surprising from an amateur on the internet. The main thing chess.com have seems to be their Strength Score algorithm, which IMO is probably developed and maintained by a team different from the one that prepared this report.
I’ve seen wonderful and factual data analysis presented in the most horrible default templates and hacked together screenshots.
Honestly, you don't need "design skills" to make a decent graph ... just the wherewithal to think about what would make a graph clearer/easier to understand the same we expect of ourselves with writing.
I suspect there'd be a tendency to presume a design process is more like solving a problem with a clear techniques for arriving at an objectively correct solution, when in reality, it can and often if just the iterative process of assessing-adjusting-repeat. Being better at these things to the point of sometimes reducing the iterative loop to 0 repeats is "design skill". But the essential base-line ingredient, IMO, is being willing to enter the iterative cycle at least to some extent.
That obviously shouldn't be possible. If he only cheated in 1/3 of the games in the event then his performance should have been much worse than events where he cheated 100% of the time.
And I don't understand how they can say this:
>However, while Hans has had a record-setting and remarkable rise in rating and strength, in our view there is a lack of concrete statistical evidence that he cheated in his game with Magnus or in any other over-the-board (“OTB”)—i.e., in-person—games.
So what the hell? They pored over his OTB games, found no evidence of cheating, but then wrote 70 more pages? And even the circumstantial evidence is weak. They base a lot on Hans having unusually late improvements. But it's not like they're an order of magnitude better. He's slightly better than #2. And it's a simple fact that someone is going to have a late career rise that is better than anyone else. It's not evidence of cheating.
IMHO, Magnus or Chess.com need to pony up some hard evidence or STFU.
At the age of 18: https://en.wikipedia.org/wiki/Viswanathan_Anand#Early_chess_...
Also, according 2700chess.com he was #96 in the world with a rating of 2520 on January 1988. That's right after turning 18. Growing up in India (before the chess boom). Before chess engines existed. 6 months later he was #49 in the world. https://2700chess.com/players/anand
A year earlier (at 17), he had won the world junior chess championship (U-20). Not exactly a "strange meteoric rise" for Anand. The "GM at 18".
https://en.wikipedia.org/wiki/World_Junior_Chess_Championshi...
Meanwhile, at the same age of 18 (already during his covid boost), on July of 2021, Hans Niemann was #20 among all juniors (U-20), with a rating of 2571. Close to #300 on the global rating list: https://ratings.fide.com/profile/2093596/top https://ratings.fide.com/profile/2000059
Unlike Anand, no achievements of note until then (ok, he was 9th at U-16 World Youth Chess Championships in 2019). A year later he's a top 40 player, hanging out with the best and beating the (incredibly dominating) world champion with the black pieces. Make it make sense.
Also, take a look at this analysis of correlation between average (and stddev) of move accuracy vs rating:
https://www.youtube.com/watch?v=YnnJ0Da4Rp0 - explained in the detail
https://www.youtube.com/watch?v=Q5nEFaRdwZY - analysis applied to several players
Hans Niemann didn't win the game. The incredibly dominating world champion lost it. He bodged the game and then threw a tantrum calling the other, weaker, player a cheater to save face because he couldn't stomach his own incompetence.
The rest is what is called "circumstantial evidence" in the lay press.
None of the similarly rated players at the same age did anything similar during "Covid times and The Queens' Gambit boom".
Watch the videos I linked at the end of my comment and tell me how covid times contribute to that anomaly.
IMHO everyone needs to either put up hard evidence or shut up.
Finally he gets on a NFL roster as 3rd string for St Louis. Cleveland skips picking him in the expansion draft. The Rams sign a different starting QB and trade away #2 QB leaving Warner as the backup. The starter gets hurt and with basically no first team practices Warner gets named the starter.
After all that and starting for the first time in the NFL at age 28 he has one of the best statistical seasons ever for QB and wins the MVP and Superbowl. Goes on to win the MVP again and has a 10 year HOF career.
If we apply Chess.com's logic he's the biggest cheater that ever cheated. But obviously he's not because you can't really cheat at QB in the NFL.
Since cheating is arguable habit forming, he simply based his career on cheating. Where others put in the mileage, he invested in his cheating expertise.
Is this an accurate statement given that, because of this report, we are now aware that a lot of other GMs have cheated as well?
What about the stress of the players he's cheated against?
If, for some reason, you decided to drop your budding music/engineering/whatever career at age 20 to focus entirely on chess, and you had the natural aptitude to be able to become a GM, perhaps it could happen. But rarely would a person decide to do that, if they had not prior to that point.
I think both effects have something to do with it.
In other words, you can only learn a language natively, if you have some good reason to do so, like say money.
But, your basic point that both effects have something to do with it, is surely correct.
However, accent is only one part of language. I certainly didn’t have the vocabulary, reading speed, writing elegance, etc. of (educated) native speakers.
Totally unnecessary sentence that just leads to derailment (like in this subthread).
I haven't gone over the report thoroughly, but it's clearly focused on Hans's conduct and not so much on the state of play regarding online cheating, which is, even by Magnus's statement, the chief focus of all of this.
As an outsider to the chess world, this revelation of rampant online cheating is the main story.
First, not surprising, right? Using a computer engine is part of learning and preparing in chess (AFAICT). What other sport has a similar issue where an extremely useful and essential and highly available tool in the sport is considered cheating based entirely on using it within the narrow window of a game? Of course it was going to leak into play in online games where you only have the data feed of moves and nothing else connecting the players.
Second, that it's common amongst the elite of the sport is huge. Either online chess is somewhat dead on arrival as a sport and was never taken seriously by many players (which makes sense to me given how integrated computer engines are in the sport) ... or the chess world needs to go through some sort of cultural revolution here.
Third, chess.com have a conflict of interest in this meta-discussion, I presume, as they have commercial interests in the survival of online chess.
Fourth, the OTB cheating question still seems open and it seems plausible to me that a good chess player would cheat online for followers and income and entrance to tournaments and then use OTB as the real testing ground. My bias here is that I suspect cheating in OTB is just crazy by comparison as you'd have to carry some sort of device that would stand as hard evidence of cheating while in online play the proof is always circumstantial and so easier for a cheater to convince themselves they won't get caught. Which gets back to my second and third points about how online chess maybe doesn't make much sense and chess.com aren't quite seeing the forest for the trees on this.
Pretty much every e-sport with hidden information has this issue. CS:GO, DotA2, SC2. They all have replay analyzers to reveal the map and let you look back to figure out how to play better. But if there was a way to use them in game (map hacks), it'd invalidate the game.
I suppose any strategic, turn-based game breaks down as soon as you have a world class engine for it.
Yep. Perhaps just a consequence of technology and an oncoming "singularity" ... professional sports just don't make much sense anymore apart from their value as entertainment (which is already questionable in the case of Chess IMO) and all of the noise around cheating etc is much more about "being immersed in the story" just like good film directing and VFX/SFX. You're either a fan or aren't and that's just how it is.
Hopefully the love and appreciation for amateur sports makes a return ... not much to cheat for if the only prize is pride and pleasure.
eSports are similar to normal sports in the fact that even if you have complete information, you need the physical skill to back it up. Professional DotA / SC2 / CSGO players would still wipe the floor with a mediocre player using maphacks.
Seems like you gotta beat Magnus for your cheating to matter?! Snark aside, Magnus’s behaviour makes some sense, he wants this to be addressed. But the manner in which it is happening, his conduct included, is just poor form for the sport, even if it was the best overall move Magnus could make.
I don't know if Hans cheated beyond his admissions. Online seems plausible if not likely to me. OTB seems much less plausible. But this report being leaked to the WSJ, then goes up on the blog, immediately ahead of Neiman's next big event? That definitely an intentional PR campaign, and that comes across as scummy to me. I'd say doubly scummy consider the report itself establishes how prevalent cheating on chess.com is among GMs, yet nothing like this sort of public disclosure has happened in other cases. It's hard to interpret this as anything but selective enforcement based on Carlson's reaction to a specific player and game.
I've gotten the vague impression over the years that the chess establishment isn't the most fair and non-corrupt organisation (par for the course perhaps for sports organisations). It also seems to be relatively behind or new to massive cheating scandals (??). Put together an event like this was almost certainly going to be ugly and unimpressive.
Your argument doesn't hold much water.
i could not care about bike racing due to doping, literally all top racers were doping back when i was following it. i can no longer watch it without doping in the back of my mind after all of it started coming out. Olympiads to me are the same.
if cheating in your sport is not dealt with it will grow like cancer .
The history of the game of chess knows around 30 players who have at some point exceeded the dream mark of 2600 Elo points.
On the other hand this https://en.wikipedia.org/wiki/List_of_chess_players_by_peak_... puts 125 at over 2700
Grandmaster rank is achieved via a peak Elo of 2500 plus gaining two grandmaster norms[1].
[1]: https://en.wikipedia.org/wiki/Grandmaster_(chess)#Current_re...
You were replying to a comment that said
"Anonymous Confessed GM"s on the cheating list, most of them with a rating much higher than Neimann's.
The highest rated "Anonymous Confessed GM" in this table in the report is a 2686 Elo.
the are proven cases of gms selling/throwing games so you can earn norms for gm title (understandable phenomenon when considering effort of getting to gm level vs little money you can make from it, gm from poorer country has big incentive earn extra $).
Therefore, Neimann.
There's a story that Ted Williams told him "you need to hit the inside pitches for power" and Tony went and did that; he never became a huge home run hitter but he improved. https://www.sandiegouniontribune.com/sdut-gwynns-hitting-coa...
Really? My takeaway is that chess.com is doing a better job of detecting cheaters than FIDE, who seem to have been asleep at the wheel with Niemann
> Fourth, the OTB cheating question still seems open and it seems plausible to me that a good chess player would cheat online for followers and income and entrance to tournaments and then use OTB as the real testing ground.
This seems wildly implausible to me. Niemann‘s OTB rise would be indicative of a not just significant but utterly world historic chess mind, head-and-shoulders above Fisher and head-shoulders-and-entire-torso above every other player in history. When led into uncharted territory by the world chess champion, Magnus indicated that Niemann seemed utterly and completely untroubled - and yet he’s, what, running stockfish in another window for $1000 prizes online and getting himself caught dozens of times? Why? Why take the risk against opponents he should beat in his sleep? These should have been sleepwalk games for this Fisher++ genius who’s totally untroubled by a 5 time world chess championship, but he’s for some reason making obviously weaker moves when not switching windows when his unaided moves shouldn’t have been screamingly weaker than the aided ones given his singularly extraordinary chess rise.
It beggars belief. His world historic rise in rating alone is ludicrously over the top. Kid’s an obvious fraud.
They banned him after August 2020, and only reinstated him after a full confession the next year.
The fact that, after having being caught red handed in online for-prize tournaments and knowing he’s being monitored very closely online going forward, he suddenly starts rising at a world-historic pace (at an age this has never before happened at) at OTB tournaments suggests to me that having lost the ability to reliably cheat in one forum he turned his attention to another.
Regardless, there's obviously a huge difference between "no evidence he cheated after August 2020" (wow, guess his heart grew 3 sizes that month) and "no evidence he cheated after a 5 month ban which required him to beg to get his account back, made it very clear to him that they were watching him like a hawk, and they wouldn't let him play in tournaments even after that" (not exactly indicative of an unprompted improvement in his morals).
On the other hand, in OTB classical chess the difficulty is in bypassing the security controls. Players are much closer to engines, and far fewer moves appear to be completely inhuman. Furthermore, with an accomplice that is also quite good at chess, those lines could just be discarded. This makes it much easier to both play very good moves that are not all that suspicious, and take enough time to "sell" the thinking time.
This doesn't mean Hans cheated over the board, just that without very good physical security, any unscrupulous GM could gain 300-400 points virtually undetected, other than from the fact that they are playing much better than they used to. If security is a top priority, at the very least we need to do what the Sinquefield cup did in the last few rounds: No spectators and a 15 minute delay, so that all communication with computers/co-conspirators has to include the player relaying all the moves out before they can get any help.
This. And then let's test this Niemann character, as now I'm really curious as to whether -and how- he cheats at OTB.
> In conclusion, while we cannot definitively prove that Hans’ rise in strength is entirely “natural,” we have also found no indications in the game data to suggest otherwise. While some have suggested that a move-by-move analysis by humans may surface some oddities in move choice or analysis, there is nothing in our statistical investigation to raise any red flags regarding Hans’ OTB play and rise.
> Hans is consistently above many contemporaries in strength increases, even though he has only recently shown the same caliber of play. Likewise, as set forth in Figures A and B below, Hans had the fastest and biggest increase in his score over time in comparison to his peers and other notable players, when considering all of their known Classical OTB games played from age 11-19.
Which should raise a lot of red flags given the nature of the “peers” (Fischer, Magnus) and its very sudden occurrence after being banned from online tournaments. It’s much harder to detect computer-aided cheating in classical time control moves than in speed chess (where they detected it in his online play) — not least because, as they note, they have no access to time-usage data for the OTB events, which would be critical to any such analysis. Nevertheless they do flag 6 OTB events that their FairPlay team believes merits further analysis by FIDE, in Appendix X.3. Reading between the lines I think that’s about as strong a statement as they can make without fully creating political issues with FIDE, who they’re probably hoping will work more closely with them going forward.
All that said, it makes more sense to look at the anomalous nature of his OTB outcomes rather than searching individual OTB moves trying to find a smoking gun given chess.com’s relative lack of data there, and the political entanglements involved. And as for that
> While we don’t doubt that Hans is a talented player, we note that his results are statistically extraordinary.
> At the outset, we want to make clear that while these events highlight a critical topic in chess—cheating the vast majority of chess games do not involve any cheating. We estimate that fewer than 0.14% of players on Chess.com ever cheat, and that our events are by and large free from cheating. We firmly believe that cheating in chess is rare, preventable, and much less pervasive than is currently being portrayed in the media
Your average person playing blitz while seated on the toilet has little incentive to cheat, particularly if it involves setting up real time access to a powerful engine ... One expects almost no cheating in such an environment.
What if the numbers are: 1/700 cheat, but 1/7 GMs cheat ...?
You might be overestimating how difficult this is. The free Stockfish app on your phone is enough to crush any human player.
Cheating is a part of every competitive thing human beings do, unfortunately. Chess is no different.
In Magnus' recent interview with Lex Fridman, he said though members of his team utilize engines in preparation, it's not something he personally uses very much if at all in his training. In fact he seems to think training against engines can be detrimental.
---
Transcript from: https://steno.ai/lex-fridman-podcast-10/315-magnus-carlsen-g...
Lex: How much do you use engines like Leela and Stockfish in your preparations?
Magnus: My team does. Personally, I try not to use them too much on on my own because I know that when I play you can obviously cannot have help from from engines and often I feel like often having imperfect or knowledge about a position or some engine knowledge can be a lot worse than than having no knowledge. So I try to look at engines as little as possible.
Lex: So yeah, so your team uses them for research for generation of ideas but you are relying primarily on your human resources.
Mangus: Yeah, for sure... I can evaluate as a human. I can know what they find unpleasant and so on and it's very often the case for me to some extent... And so then looking at the engines doesn't necessarily help because at that point you're facing a human, you have to sort of think as a human.
But ...
1) Magnus is one of the greatest ever, so he doesn't count as an example;
2) From excerpt, his *team* does use engines, and he *uses his team*. So his use of engines is one degree removed compared to others, which hardly matters, especially given point 1 above.
And it makes sense - if he’s the best he really doesn’t have someone better to play against to “learn” so finding plausible situations could be useful.
I wonder if that’s one of the things - he felt like he was playing a computer.
How is this a conflict of interest? It's just regular old interest. They are interested in Chess continuing to grow.
Cheating is particularly easy in any online context and those who dismiss the notion that online sports and gambling aren't infected with it are simply naive. People cheat in competitive bass fishing where all you have to do is cut the fish open to catch them ...
So he was re-banned for absolutely no reason.
He kept his side of the deal, i.e. not cheat again on chess.com platform. Chess.com didn’t keep theirs.
But the document paints a different picture. He cheated, and they agreed to re-enable his account if he promised to not cheat again.
According to chess.com he kept his promise. So why the sudden new ban?
I would agree with you that the initial cheating was enough for lifetime ban. But chess.com decided against it at the time.
Reconsidering their decision 2 years later without new evidence, is kind of shitty.
Happens all the time in all kinds of fields.
All of this led chess.com Fairplay staff to request that leadership re-review Hans' account, with updated analysis they provided, and to reconsider the removal of Hans' ban.
Page 58, from the text of a letter chess.com sent privately to Hans, just after they banned him:
"When I received your confession back on August 12th of 2020, in light of your age, I allowed you to create a new account with no fair play markings to continue to stream chess... For my team, however, there always remained serious concerns about how rampant your cheating was in prize events. In finalizing the field for the upcoming CGC, and based on a growing concern regarding ensuring fair play in Chess.com’s first million dollar prize event, my team did a deep review of your past history, and encouraged me to rethink my position of letting you continue to play in prize events on Chess.com. I ultimately made the decision that too much was at stake given our ongoing suspicions and past violations." [Emphasis added, 1]
This is an example of where such internal controversy is discussed.
[1]Full text of this section of the letter: "Moving on to my second point, I want to address both the reasons and timing for freezing your account and rescinding your CGC invite. For my team, however, there always remained serious concerns about how rampant your cheating was in prize events.
When I received your confession back on August 12th of 2020, in light of your age, I allowed you to create a new account with no fair play markings to continue to stream chess. You’ll remember that I worked hard to both advise you on this process and to protect you as much as I could. I would do that again for you or any young player I deemed to have lost their way and wanted to choose a better path forward.
For my team, however, there always remained serious concerns about how rampant your cheating was in prize events. As you know, we’ve closed the accounts of hundreds of titled players (including 4 of the top 100 Grandmasters who have confessed to cheating), and we carefully monitor and help all of them as they rehabilitate into participating in our events. You and I had many subsequent discussions in our Slack DMs where we openly cooperated on the right way for you to rebuild your reputation.
In finalizing the field for the upcoming CGC, and based on a growing concern regarding ensuring fair play in Chess.com’s first million dollar prize event, my team did a deep review of your past history, and encouraged me to rethink my position of letting you continue to play in prize events on Chess.com. I ultimately made the decision that too much was at stake given our ongoing suspicions and past violations.
Considering the above, we made this decision to close your account privately and uninvite you from the CGC. I regret the timing, but the timing between the Sinquefield Cup and the CGC required me to move quickly to replace your spot. I believe I acted in the best interest of the game and all participants to reconsider our invitation with so much at stake.
I’m going to bring my letter to a close with an offer to have a call. If you are willing to correct the false statements you made about having never cheated when it mattered (now that you have said these untruths publicly), acknowledge the full breadth of the above violations, and cooperate with us to compete under strict Fair Play measures, Chess.com would be happy to consider bringing you back to our events. In fact, I think it would be a wonderful redemption story for the full truth to come out, for the chess world to see this and acknowledge your talent regardless of your past, and give the community what they deserve: The truth."
Public: "So he's been cheating recently?"
Chess.com: "Oh yeah, he cheats all the time. Everyone does, really. Online chess is like 50% cheaters/bots, don't expect any real humans here, this is like 10x worse than Twitter."
Either way, chess.com kept their side of the deal, their side of the deal was "and we can ban you at any time in the future for any reason or even no reason whatsoever". Frankly that strikes me as a very fair term in a deal for reinstating a admitted cheaters access to your tournaments with large cash prizes...
As stated in the report, the reason he was banned again was that the insinuations from Magnus caused the chess.com team to reevaluate whether or not they could trust him not to cheat going forward, especially with an upcoming tournament with a million dollar prize on the horizon. After this reevaluation, they decided their previous leniency was unwarranted.
Edited to warn people that that portion of my post was incorrect.
If somebody has a prodigious history of not playing by the rules, there is no reason to think they'll ever reform, and it isn't worth the reputational damage to the game both within (Magnus) and without (the public's perception of high-end chess). This has been a fiasco when they should have just banned Neiman once it became clear that he's been consistently cheating for years.
Is Chess.com gonna reveal similar reports for every other player or is this privilege only for those who are accused by a chess.com part owner of OTB cheating.
I can understand their online tournaments being something they care about and why they might rescind an invitation based on these allegations but there's something very strange about them taking it upon themselves to ban him from the platform as a result of his play against someone whose company they're in the process of buying.[1]
It seems to me as though they're inserting themselves into this unnecessarily with their analysis too. They spend a great deal of time explaining their rationale in a few places and then toss in a "In our view, no conclusions should be made from this data." at the end of it. If no conclusions should be drawn, don't bother sharing the data; it's useless. By sharing it in this manner, they are attempting to pretend it's reliable and effectively make the accusation with an out to claim they didn't.
This part too:
And while Magnus’ actions prompted us to reassess the situation, Magnus did not talk with us in advance about our decisions or ask for, or directly influence, those decisions at all.
An uncharitable reading is that this is a very honest statement. Magnus may not have directly influenced their decisions but I think it would be hard to argue they don't have a vested interest in this for the reasons above. IMO this is a clear conflict and they should have simply withdrawn his invitation, even suspended him from their platform, but refrained from commenting on the over-the-board controversy entirely.[1]: https://kommunikasjon.ntb.no/embedded/announcement?publisher...
They run money tournaments and hope to have top GMs join and advertise their service by playing, streaming, and commentating the tournaments. You really don't see why they would prefer not to have an OTB cheat invited to these events?
Not to say that Hans has been proven to be a cheat, but it does explain why they have to care about cheating in any event, anywhere.
No, I definitely see why they would rescind his invitation. I mention so in my post you're quoting from.
My question is specifically about the "analysis" they performed of the over-the-board game that started all of this off.
I agree. Inline with your comments, the report has to me a bit of the vibe of an PR department scrambling to get ahead of the story. The poorly and inconsistently formatted graphs indicates they were pulled out of various documents written by various people at different times. And the spray and prey arguments that don't go any where make it seem like they're desperate to appear as objective and unbiased as possible ... which indicates that they are very biased in their urge/need to respond to the "Magnus refuses to play with Hans" situation.
If their cheating detection is so good, wouldn't it be reasonable for chess.com to say to Magnus that you don't have to worry about cheating in our tournaments so you'll play whoever you're paired with and you can leave it up to us to ban people because we know what we're talking about. Why ban Hans now, right after Magnus's ultimatum?
As one example, chess.com thinks it’s suspicious that Hans became a grandmaster at 17 instead of a younger age (page 15 of the report), but keep in mind that the legendary Joseph Henry Blackburne didn’t learn to even how to play chess until he was 17. More recently, world champion #15 Vishy Anand did not become a grandmaster until he was 18.
Point being, it argues like a polemic, not a fact-finding report. They themselves admit this. On page 19: “Chess.com is unaware of any concrete evidence proving that Hans is cheating over the board or has ever cheated over the board”.
My personal hurdle, which has not changed in the last month, is real evidence of online cheating on or after June 20, 2021 (Hans’s 18th birthday), or real evidence of over the board cheating. Understating the extent of his online cheating in his September 6 speech is not evidence of recent cheating. I don’t like it, but it might not even be deliberate lying, but a combination of a foggy memory and nerves.
Regardless, while apparently guilty of online cheating when he was 17 or younger, and possibly guilty of understating the extent of his juvenile delinquency, I see no need to ban him from playing over the board chess with the evidence we have on the table. To ban someone as an adult for something done while a juvenile is generally considered immoral, and to ban someone without solid evidence is also considered immoral. This is a line I draw in the sand and will hold to.
Would you play him for money at a game where you are both equally skilled and it's easy to cheat?
I don't think it's so clear, especially when the time elapsed is short.
If you cheated I'm a game we played yesterday and today is your 18th birthday I'm still not going to trust you today.
They are going to be defending 100% their investment.
Magnus Carlsen has put his reputation on the line by calling out Hans Niemann for cheating. Many people have criticised him for doing saying there is not enough evidence.
Chess.com has an interest in defending Magnus's brand since they are buying his companies.
At that point does it even have to be chess?
I think anybody who knows how online chess tournaments work assumed those two times would cover multiple games and dates.
Other statistical analyses have been published that indicate no evidence for OTB cheating.
The negative against Niemann is the cheating is beefier than he indicated, and given the spotlight he needs to be more thorough.
Chess.com has a dog in the fight though, and it's bark seems worse than its bite here...
That's fine, but gives the surface impression of being heavyweight while the important stuff is only a few pages and adds little that is new and nothing that delivers a knockout blow that justifies the onslaught against Niemann led by Carlsen's antics that kicked the whole thing off.
Chess.com says this is not the case by their analysis.
Cheating when you're 12 in matches that don't matter is one thing. Cheating in your late teens in tournaments with money is an entirely different one.
> As we mentioned earlier, we have made no public statements regarding the reasons for your account closure or our findings, and anything that happens in this conversation will remain confidential.
But they did at least hide the player identity, so we only know it's a FIDE top 100 nearly-2700 player.
I'm slightly surprised at how easy they make it for a confessed cheater to unban themselves:
> As a titled player, we would like to offer you a chance to re- establish yourself within the Chess.com community, and because of that, we have made no public statements regarding the reasons for your account closure or our findings. If you choose to acknowledge any of the behaviors that you feel might have resulted in your account being closed within the next 72 hours, we may try to work with you privately to have a new account opened, equipped with a title and Diamond Membership.
>... Chess.com appears to violate their promise of confidentiality...
I think they believe that Nieman bringing his alleged cheating at Chess.com into the public arena, and saying things about it that Chess.com believe are not true, broke the agreeement between them, and gave Chess.com the right to respond
[1] https://www.reddit.com/r/chess/comments/xvo7u4/comment/ir2el...
>This person competed in a single event featuring 10 total games in 2020.
They either created a new chess.com account, or totally ceased playing on there around or after July 2020. They were a Top 100 player with almost a 2700 rating.
Those facts combined probably narrow the list to extremely few candidates, perhaps only 1. I don't know chess well enough to identify them.
his learning curve is a little steeper than the others... that doesn't convince me the otb games were fraudulent.
For chess, maybe your rating doesn't mean anything until you've gone through a "verified" bunker-play tournament that operates as a sort of baseline for your ability at all subsequent games until the next one.
For example, if you were watching WCC, one cannot conclude who is better by simply looking at game 9 out of 14. Comebacks happen often.
Even the ELO rating has its drawbacks in determining true strength of the player.
If Magnus plays Hans for 5000 games, sure. Not a chance, at least statistically speaking, in 10 games.
Famously Kramnik, one of the greatest players of all time, blundered mate in one at classical time controls, which is literally a beginner-level mistake.
If that still doesn't narrow it down to one person, then the widths of the redaction black bars will finish the job.
Edit: Not sure where the downvotes are coming from, but just to be clear, Exhibit C is some totally unrelated bystander with nothing to do with the Niemann case. These emails, and by proxy the person's identity, are being published for no other reason than for chess.com to fluff up their cheating etection credentials. How is this acceptable?
For better or worse, this could represent a metric for gauging how well that discipline is at detecting active cheaters.
I think clusters of cheating would be especially prevalent in cases where there was a finite pool of positions available, and more people than that who wanted to get a position. If you know others are cheating, it's a pretty strong rationalization for cheating yourself, and the more prevalent the cheating, the stronger the rationalization.
I also know from my time at school, cheating is fairly prevalent there - even at top rated universities. Lots of universities have developed fairly sophisticated statistical tools for catching cheaters, similar to what chess.com has.
I suspect the organizers of Chess.com are at the beginning of a cat and mouse game that will produce more sophisticated detection algorithms, which in turn will help develop more sophisticated chess engines.
I bet that for lovers of chess, who want to continue to enjoy their passion, this is a critical problem to figure out.
However, can we expect that in games, sports, arts, humans will continue to compete with each other without any forms of artificial aid? Or should we instead explore now what augmenting human's cognition means for our culture? Starting now might be the only way to creating a framework to ensure success (however we want to define it) in the long run.
If not it seems unfair to other high profile players.
But imagine they do, will those players get automatically banned from the website? Will tournaments require a proof of your online score and "non-cheater" certificate?
A part of me seems to see this kind of automated analysis dangerously intrusive. Another part of me sees a big monetization potential for the platform.
The most important metric is "Number of games flagged by our cheat detection system", and they don't show the baseline for that.
——
But yeah, no spectators and a delay should be pretty effective OTB.
The amount of data required to communicate a chess move is very little.
Long live chess.
Given the massive volumes of chess data out there, I bet it would be easy to make a bot that mirrors the win/loss and blunder/best move ratio of an average GM chess player’s trajectory.
Instead of picking the best move all the time, maybe pick a random move out of the top 10 moves. And use a random number generator to determine if you make a blunder. And use an engine that’s appropriate to your current rating.
It looks like Hans might have been picking the best moves from the best engine in those games where he got 100% accuracy, which is a dead giveaway.
If you’re patient enough to sit through hours of slowly progressing your rating through a few wins, lots of draws a few losses, I bet you could do it undetected. And don’t give any interviews!
Hans probably didn’t think about the trail of data he was leaving, or got greedy.
It's a similar idea to the 'Biological Passport' seen in sports wherein the biological data of an athlete is stored and you can reference the data points against new test results to see any anomalies.
Creating the "perfect cheating engine" would only be useful for unknown players, and in chess, it's literally impossible to be an unknown and play at a Super GM level (its happened, and of course they were immediately exposed for cheating).
Now, if someone like Hikaru or Magnus decided to just automate themselves at their best in the form of a bot, yeah, it would be nearly impossible to detect them on data alone.
As a proof of concept it would be interesting to create an AI that has an undetectable natural progression and human-like play style.
Is it unlikely enough that it offers convincing evidence that we live in a simulation? (i.e. he acted based on information he received from outside our reality)
> In fact, Magnus has only played 4.g3 twice previously (both before 2010), and the position after Hans castled on move four had never been seen in any of Magnus’ games. Hans in a later interview commented that Magnus had previously played the opening against Wesley So in the 2018 London Chess Classic,24 but there is no such game on record.25 Magnus did play a g3 Nimzo-Indian against Wesley So in a rapid game in Kolkota in 2019, but the move order and emerging position in that game had no similarities to the game against Hans. Hans’s 9...cxd4 had only been played once previously, in a June 2022 Titled Tuesday game between Rasmus Svane and Stelios Halkias.
Besides, everyone here just wants to know: Was he cheating with a "secret device"? Just publish a paper that says yes or no, that's all we want.
Hustler Casino livestreams a regular game with High Stakes Poker. A new player who is also a wealthy model wife type made a call against a pro that sucked out where her decision making was baffling. Off camera but on mic the pro demanded his money back. Then it blew up into a giant drama of accused cheating.
Here's my read on what happened: this woman is basically buying her way into being a poker celebrity, something many people have done before, some of them successfully in the long run. She's new the game, and pretty clearly not as sophisticated a player as the rest of that table, to put it mildly. This hand would be a very bizarre one to cheat in, as there were others with much more upside and that would trigger less suspicion. On the other hand, new players often combine both overconfidence with nervous panic, especially when say this is the biggest stream you've gotten onto yet with your plan.
So basically I think she just made a huge emotionally driven donkey call like you'd see at a drunken house game, then just said whatever she thought would sound smarter than "I did a donkey call." Then when this big figure in the poker world is giving her the death stare and then asking for his money back, she probably just wanted to put out the fire as quickly as possible.
This is by far the most parsimonious explanation.
I played in a weekly game back during the early 00's poker boom, where one guy that showed up pretty clearly just wanted to get away from his wife and get drunk. It was a low stakes game (intentionally so diverse friends could play) and the amounts involved were totally immaterial to him. He had zero problem being the fish of the game and no real pride in his play or the outcome.
There's some advice about never being better than your boss, particularly in public.
I despise it, btw.
She destroyed everyone that day. It wasn't because she was a stronger player in terms of her rationale behind each decision. It happens. You really can't conclude jack from 2 sessions.
If you know they are going to bluff if they miss, it's very profitable and also maddeningly tilt inducing.
I once called $5k cold on the river and won with J high and several over cards on the board in what ended up a $15k+ pot.
Her move esp by a somewhat amateur player is not that outlandish.
When people start to deviate from stuff like that, it is either assumed that the player is cheating, or a complete beginner.
Same with chess. When top players start making really weird moves, they're either getting computer assistance - or they've made a nonsensical move. And for people that seemingly never do nonsensical moves, it is easy to conclude that they must be cheating.
It is actually not too different from video game speed runs. The margins are so small, and all the top level players know every move. Discovering new stuff can take years - so if a newcomer suddenly starts making waves, beating seasoned pros left and right with seemingly genius strategies - is he a genius, or cheating? Most in the community will go for the latter.
Oh? What? And GMs admit to cheating online? Why then is Niemann's possible/likely online cheating news and not the other GMs'?!
Fine, but let's say he's cheating online and that it's more a scandal than those GMs' cheating, and that it being more of a scandal than other GMs' cheating is not in itself a scandal. Now let's look at the OTB issue.
So they have no evidence of Niemann's cheating irl, OTB. And he beat Carlsen w/o cheating, OTB.
And Carlsen threw a fit.
So now chess.com is practically libeling Niemann. They can't prove he cheated even online, but then, Niemann can't prove that he didn't either, and we'll all believe that he probably did because... we'll believe most players do cheat online. And as for the OTB game with Carlsen, there's a video of that game. And Niemann's explanation of his pauses and his thinking in that game are sensible. So chess.com will not come right out and say he cheated OTB -- perhaps that would be a bridge too far in any possible libel case?
I don't know if Niemann cheated, and maybe I don't care because what this brouhaha is leading to up is this conclusion: online chess is so trivial to cheat at that money-making online contests and online game ratings should now be a thing of the past. And that is a conclusion chess.com does not want the public to reach, so they're trying real hard to look like they can do something about cheating at online chess.
Chess had a great revival these past two years because of covid. Chess is very accessible, easy to learn (to a point), very watchable, and trivial to make it playable online. But chess is also a practically a solved problem, with AI and non-AI chess engines that easily beat grand masters and world champions, and it has been a solved problem for quite some time, and now those engines are trivially available to people trying to learn, to analyze, and/or to cheat. That means that cheating will be trivial. No amount of focus change detection or whatever is going to help because you'd have to have cameras and microphones capturing the whole room that a player is in to keep most players from cheating.
Maybe it's time for chess to go back to being an in-person only thing for ratings and contests with real prizes.
Also, let's not talk of the ageism in chess.com's complaint that Niemann is too old to be that good at chess. It's true that generally speaking chess has to be learned early in order for one to get good at it, but there's always humans who defy the averages.
The best humans play at an Elo rating of 2800. “Stockfish,” the most powerful chess engine, has an estimated rating of more than 3500.
This may be the most terrifying statement I've read all year. From parity to ovewhelming dominance in two decades. And it may just be approaching the base of the S curve. I for one welcome ...There used to be this fantasy that the best player would be a human augmented by a computer, optimally blending their respective gifts into the best moves. Ha. Nowadays it would be like a baby in a crib helping a heavyweight champ.
> In a 1000-game match, AlphaZero won with a score of 155 wins, 6 losses, and 839 draws. DeepMind also played a series of games using the TCEC opening positions; AlphaZero also won convincingly. Stockfish needed 10-to-1 time odds to match AlphaZero.
https://en.wikipedia.org/wiki/AlphaZero
It is savage.
The current version of Stockfish is Stockfish 15, and although it hasn't played AlphaZero (because AlphaZero doesn't compete), it has played clones of AlphaZero such as Leela Chess Zero in TCEC which it won against consistently for the past 5 seasons.
AlphaZero beating Stockfish was more a propaganda attempt from Google to appear as a world leader in AI then an actually attempt to find the superior engine.
Here are the actual stats: https://en.wikipedia.org/wiki/Top_Chess_Engine_Championship#...
Leela Chess Zero is definitely not as strong as Stockfish 14 but still ranked #4. That's not nothingburger.
> AlphaZero beating Stockfish was more a propaganda attempt from Google to appear as a world leader in AI then an actually attempt to find the superior engine.
Wtf?
[1] https://www.chessdom.com/garry-kasparov-carlsens-behavior-wa...
[2] https://www.youtube.com/watch?v=1LaEipwGi0o
His Twitter feed is all Ukraine stuff, AFAICT. Maybe he's said something more than the above (?)
Personal story: I was the host at his Google talk in Mt. View in July 2017. I had to find a room for it, which was super-hard and getting worse all the time. I got a room that held 100 people, and I really didn't know how big a deal Kasparov was. I underestimated that, I guess, but remember that by 2017, Googlers could watch from their computers, so they didn't have to attend in person. I don't think he could have filled up Charlie's Cafe, which holds 450 (if it was even available).
Anyhow, he complained that the room was too small. Jerk.
(If you look this up on YouTube, you won't see me; they used his London talk instead.)