I’m as skeptical of OpenAI as just about anyone, but Marcus just seems to engage in the kind of contrarian ranting that happens to people when they spend too much time on social media. I would say a better indication of o3’s performance is François Chollet seeming kind of bummed that LLMs have reached this point, contrary to his expectations.

EDIT:

In the interest of not being overly negative myself, I found Nathan Lambert’s more measured and detailed breakdown far more instructive:

https://www.interconnects.ai/p/openais-o3-the-2024-finale-of...