> LLM labs are so focused on making those scores go up it’s becoming a bit of a perverse incentive.

This seems like an odd comment to post in response to this article.

This is about showing that a new architecture can match the results of more established architectures in a more efficient way. The benchmarks are there to show this. Of course they aren’t going to say “It’s just as good – trust us!”.