Using a shittier model is just more work for the user, I’m not sure why anyone does it, unless they’re playing with it like a toy.
Isn’t that just more work than logging it yourself?
Automating it has been way better for me than the alternative of breaking my flow whenever I'm switching tasks to chart my time, or logging all my hours for the week in one sitting. Different strokes for different folks I suppose.
That’s an insane level of detail and I can understand why it makes sense to use an LLM to remove that busywork, otherwise you’d be spending half of your time on this bureaucracy.
For the company I would imagine it could be more cost efficient to stop being so onerous instead of burning tokens.
Saves like $2-3 per session. Same quality code.
Model routers allow this to happen automatically without any more work by the user.
> a shittier model
A ton of tasks don't require the most expensive frontier models, etc.
> I’m not sure why anyone does it
1. Faster solutions from the LLM - also reduces employee costs of having the employee waiting on the LLM
2. Avoiding things like the half-billion dollar per month bill for a single company’s LLM use recently reported in Axios