However we cannot observe these things directly and it could be simply that OpenAI are willing to burn cash harder for now.
If they provide access to 3rd party benchmarking (not just one) than maybe I'll believe it. Until then...
Why bother with all that when you can simply charge an extortionate rate and customers will pay it anyway because it’s still profitable?
I am very confident that frontier models won’t be public at strong AGI levels, and certainly not at superhuman levels.
So companies might pay good money for these models for programming but elsewhere, I don't see where they capture particular interest yet.
I'm also wondering how performance would be tested, and how much results would depend on specific surrounding contexts (law, regulations, and so on) and what happens legally if a model breaks applicable laws.
I mean actual going-concern businesses with customers, marketing, deliverables of some kind, and support. Not toy activities like share trading.
I would go a step further and posit that when things appear close Nvidia will stop selling chips (while appearing to continue by selling a trickle). And Google will similarly stop renting out TPUs. Both signals may be muddled by private chip production numbers.