However, I think finding security vulnerabilities is one use case where it doesn’t matter. Tokenmaxxing is absolutely effective for that. We as an industry are in the middle of adopting very expensive, complex continuous fuzzers.
However, I think finding security vulnerabilities is one use case where it doesn’t matter. Tokenmaxxing is absolutely effective for that. We as an industry are in the middle of adopting very expensive, complex continuous fuzzers.
Afaik messing with the context also pretty reliably degrades performance still. The model responses reference things that no longer exist to it and it becomes more chaotic.
The real usefulness of parallel or sub-agents is not that they run at the same time, its that they isolate noisy or self-contained context away from the main window.
Have you measured them beyond loc?
Personally, I get huge mileage out of LLMs, and yes, I care deeply about code quality, readability, and debuggability.
I've seen juniors absolutely rock with them.
And I've seen the exact opposite, where they just struggle to get good results.
In the end, I think the divide comes down to management experience. The people thriving are the ones who have led teams, especially teams of contractors, which is the best analogy for how you have to interact with an LLM.
Those folks know how to break down problems, provide the right context, and scope a task just enough to see the "contractor" succeed before letting them move forward.
On the other hand, individual contributors who are used to just grinding solo often struggle. They expect a one-shot miracle. They say, "Hey, my code is buggy, fix it." When the LLM inevitably hallucinates or steers them wrong, they give up. The results are completely different based on how you treat the tool.
They might just have a high quality of control and standards that it is hard to find that pattern with the LLMs.
I think fierce individual contributors are a lot more valuable in the era of llms as well. We as humans typically achieve better balance with new stuff when we allow backlash from new processes that start to trample on old ones without understanding AKA the Chester's fence.
Anyways, more of a ramble than my two cents.
How many people were in the class?
I had a small training company, shuttered during COVID, and I used to charge 5K per day, for a group of up to 12 people. 5 days training = 25K. This is double, wow.
I would love to get back into training but getting enough volume to live and support a family on has been a challenge.
wow! That sounds like an unbelievable grift. Who were they such that anyone could possibly think that's a worthwhile investment?
In Hawaii I assume?