Note that they never say that they are most standard compliant browser. They specify the tests they are running and the % of them being passed.
Disclaimer: I know I might get down-voted for this but I work at MS(not in the IE team though :) ). Of course, my opinions are my own and not my employer's.
What I don't understand is why they don't use the latest Chrome beta to do this tests - e.g. Chrome 5.0.375.29 beta passes all tests for Dom Level 2 Style.
That's a valid question to ask and I'd tend to give them the benefit of the doubt on this. As I understand it they chose the most recent released versions of the other browsers.
If they had of chosen the most recently nightly build or beta versions and a particular test didn't work on that browser but had previously worked, ie it was a regression that would be fixed in the next build, then someone would jump all over them for "cherry picking" their competitors versions to obtain results that flattered IE the most.
Picking the most recently released versions seems to make the most sense from this point of view, though I'll allow that you could make the point that choosing the most recent nightlies of the other browsers would also make sense.
Nothing subtle about it really. They are only presenting tests in which IE passed.
IE9 is in "Platform Preview" - meaning "not even beta". It is compared against current released versions of other browsers. They will catch up, and by past experience some will release before IE.
These tests play to IE9's strengths. I don't really have a problem with that since the tests will push other browsers to catch up, but there are other tests like ACID which have different focus and showcase other browsers.
Clearly publishing a comparison of a "platform preview" (i.e. not even a nightly, it's just the core rendering engine) against the stable, released versions of other browsers is an effective psychological manipulation when even someone who is pointing out that very fact can jump to the conclusion that all these other browsers haven't progressed in the meantime.
Having said that, sorry about the poor wording. And I agree that the released version of IE trails the released version of all other browsers. This has been consistent over several major release cycles. Still, I think MS should be encouraged when they're heading in the right direction.