ARC has their own writeup on the result, which offers some nuance. https://arcprize.org/blog/astra
tl;dr it's 62% when apples-to-apples to other models, which is still notable.
tl;dr it's 62% when apples-to-apples to other models, which is still notable.