Not commenting on speed, but it seems models and their harnesses have generally gotten much worse over time. My suspicion is that the "Frontier" labs really dont have a strong handle on good quality evals that equal expectations of their users, so they just churn out new models for marketing to sell the shit out of.

Recently cancelled my Codex subscription because I cannot stand 5.6-sol/terra/luna. On top of that, Codex the harness is just so dammed buggy in VS Code.

I just discovered https://tinfoil.sh, which is fully private and attestable AI which works amazing with Kilo Code. Its costing me at API prices but for cheaper to run models which so far feel more consistent then what I get from frontier models.