Its crap at the visual Raven IQ test though, it scores 22% vs an algorithm that takes random guesses scoring 17%.
Benchmark shelf lives aren't that long.
You ommitted the fact that tuning bumped it to 26% vs random.
Sure, questionable what effort is involved in that step, but at the same time, that hints to me that tuning will be the new baseline within the next 12-24 months.
Its notable that it was able to attempt it at all I suppose.
And quite a lot of papers about that: https://scholar.google.com/scholar?q=%22raven%27s+progressiv...