What harness you are using?
The shape of my work changes obviously, so it'll vary, sometimes more, sometimes less. For example, fixing all of the bugs and defects I found that week was 2-3 times the effort and chewed through my ChatGPT allowance, but I had banked resets...
Also worth noting that codex models have been kind of all over the place recently with their usage... and it looks like costs are changing again.
Gotta be honest though, I don't love fiddling with this all the time. I would rather be working on my projects than evaluating my usage. Having DS in my back pocket should i need it is a relief. The providers get fiddly though too.
Pi out if the box tries to optimise system prompt size, which is not necessarily good and will cause exactly this effect for all but the most simple tasks.
What you want is to give enough context to the agent to minimize the amount of searching within the codebase etc.
If you want to track cache, what you should do, imho, is to check if you have cache expirations mid sessions (ideally you should not), and if you don’t then lower cache use is actually better - it means that your model doesn’t reread what it just wrote.
> First, they come for the programmers, and next the mathematicians. Then it will be the biologists, lawyers and doctors. [...] Eventually, with advancements in robotics, stabs at increasingly more physical sciences will also be attempted. Eventually, AI will have its hand in the pie of all knowledge work, if it is possible.
You seem to think raising productivity is a bad thing?
> Humanities will stake it out a little bit longer because AI isn’t human, [...]
This is really silly. Many languages other than English don't use related words to describe 'humans' and 'humanities'. Will it be easier in those languages? Should we rename mathematics to 'humathematics' or so, to make it harder for AI to take over?
Higher productivity means very little to people whose labor plummets in value over the course of a couple of years. One day they won't be needed anymore, maybe that's good for you.
I'm a software developer by trade. I welcome the coming brave new world in which machines can do all the software.
At the moment, they ain't quite there yet, alas.
People often bring up something like "oh, someone will need to maintain the robots that just took your job." But that's seldom where the new jobs are, at least not en masse: the whole point of automation is to use less labour on the task in aggregate afterwards.
Baristas making overpriced fancy coffee is something the western world started to want to afford in the 1990s and 2000s, because we were getting rich enough thanks to lots of automation and technological progress in other areas. Coffee-making itself hadn't see much progress.
The new jobs can be anywhere in the economy, it doesn't have anything to do with the jobs that got automated or replaced.
I dont consider myself a programmer but use LLMs almost exclusively for coding.
The number of people able to create useful software today is much much larger than it used to be and arguably a minority of these people are/were "programmers"
Also even if your Gemini is giving you nonprogramming output, underneath the model is most likely generating code for certain tasks.
I can’t overstate how bad of an idea I think using an AI for customer interaction is.
But yeah, send me a non solicited AI slop email or worse, political ad, and you dont get the dignity of me saying stop to unsubscribe. Straight to spam for you.
So, spam?
If someone is asking you for a quote, and your tool replies, it's not spam.
It might be slop for all I know (or might not be!), but it's not spam.
Similarly for arranging meetings with parties that you already have a relationship with.