I think the main problem is a conflict of objectives. AI companies need you to use more tokens so they are not going to improve that. They are optimizing the models to get as close as possible to the point in which people would stop using them because they are useless but without crossing that line.

Proof of this is the amount of unnecessary tasks that Claude does just as an excuse for not doing a good job doing the tasks that we ask it to do