I think it's fair to do it to the idea of AGI.
Moving the goalpost is often seen as a bad thing (like, shifting arguments around). However, in a more general sense, it's our special human sauce. We get better at stuff, then raise the bar. I don't see a reason why we should give LLMs a break if we can be more demanding of them.
> SOTA models are already capable of outperforming any human on earth in a dizzying array of ways, especially when you consider scale.
Performance should include energy consumption. Humans are incredibly efficient at being smart while demanding very little energy.
> But few if any humans on earth can demonstrate the breadth and depth of competence that a SOTA model possesses.
What if we could? What if education mostly stopped improving in 1820 and we're still learning physics at school by doing exercises about train collisions and clock pendulums?