So when I see monthly budgets in the thousands for developers at some larger companies, I'm curious to learn how they are managing to spend that kind of figure: how much code/documentation are they feeding into their prompts, are they using agent orchestration systems to make the code factory run 24/7, and how much value is coming out the other end versus before?
And, if they are pouring thousands into LLMs per developer, have they considered looking at alternatives like having LLMs running locally on own hardware with their own agent harness?
Those are the kind of questions I'd love to ask - I just wonder how much stuff is truly cutting edge and how much might be wasteful?