> If/when frontier model development speed slows down
You do not believe that this has already started? It seems to me that we’re well into a massive slowdown
You do not believe that this has already started? It seems to me that we’re well into a massive slowdown
On the one hand, most models are "good enough" for chatgpt-like usage, and there it's hard to see/feel generation-to-generation improvements. On the other hand, if you look at instruction following, dealing with long context windows, >200 tool call interactions while staying on track, there's still plenty of improvements to be had. So, hard to say where we are.
In practice, I upgraded everything to GPT-5 and the performance was so terrible I had to rollback the update.
Depends on what you compare it to. For us who were using o3/o1 Pro Mode before GPT-5, the new model isn't that huge of a leap, compared to whatever was before Pro Mode existed.