1,711 karma · joined August 16, 2009
I'm also creating one that is similar, but purpose-built for making the plans that this setup can orchestrate. It still needs some tweaking to get agents to follow it better - it still takes additional prompting to nudge it down the proper path. But I've had similar benefits - sending plans through this adversarial review loop has yielded significant improvements in final output.
https://github.com/Vibecodelicious/llm-conductor/blob/main/p...
[1]: https://github.com/Vibecodelicious/llm-conductor/blob/main/O...
[1]: https://github.com/Vibecodelicious/opencode/tree/surgical_co...
I suspect that as it becomes more economical to play with training your own models, people will get better at including obscured malicious content in data that will be used during training, which could cause the LLM to intrinsically carry a trigger/path that would cause malicious content to be output by the LLM under certain conditions.
And of course we have to worry about malicious content being added to sources that we trust, but that already exists - we as an industry typically pull in public repositories without a complete review of what we're pulling. We outsource the verification to the owners of the repository. Just as we currently have cases of malicious code sneaking into common libraries, we'll have malicious content targeted at LLMs
I haven't had this problem in a while, but I expect current LLMs would probably handle those formatting instructions more closely than the 3.5 era.
I've also found that LLMs typically just partially implement a given task/story/spec/whatever. The reviewer stage will also notice a mismatch between the spec and the implementation.
I have an orchestrator bounce the flow back and forth between developing and reviewing until the review comes back clean, and only then do I bother to review its work. It saves so much time and frustration.
I expect it to make it possible to not think about when to reset back to a clean session. I also expect it to be more efficient as it will clear out all the "garbage context" that only serves to "confuse" the LLM, cost more tokens, make responses slower, etc.
Once I get a working prototype, then I will test the feature by using it while reimplementing it in other open source agents to get a feel for whether it has the effects I'm expecting.
I don't think that's actually what's up, but I don't think it's completely ruled out either.
If you're talking about this part:
> Initially, we were unable to add capacity to the metadata service because it was under such high load, preventing us from successfully making the requisite administrative requests.
It isn't about spinning up ec2 instances or provisioning hardware. It is about logically adding the capacity to the system. The metadata service is a storage service, so adding capacity necessitates data movement. There are a lot of things that need to happen to add capacity while maintaining data correctness and availability (mind at this point, it was still trying to fulfill all requests)
The very large 2017 AWS outage originated in s3. Maybe you're thinking about a different event?
List (or set, or dict) comprehensions are really cool... one level deep. The moment you do 'in...in' my brain shuts off. It takes me something like 30 minutes to finally get it, but then ten seconds later, I've lost it again. And there are a bunch of other things that just feel really awkward and uncomfortable in Python
Overall, however, regenerative braking probably is better given the conditions don't always allow for this game.
How do you differentiate between what exists only in your head vs what exists elsewhere?
Societies make choices that have physical and pragmatic realities associated with them. Those choices impact our everyday lives.
Should I keep reading, or is the title misleading?
The abstract seems to say that the system provides memory-comparable performance for data that is... in-memory
And a good audio recorder will do wonders. Zoom h1n is a quite good budget option. Try searching YouTube for "h1n vs" - there are tons of great options.