I must be missing something: isn’t this just describing a queue? The fact that the workload is a LLM seems irrelevant, it’s just async processing of jobs?
It being a queue is one part of it yes. But the key is trying to provide tight integrations and take advantage of agentic features. Stuff like the orchestrator, having an external service to execute tools, etc.
It does not sound very specific "stuff" like the orchestration, any other queues needs to deal with assigning work?
everything's a queue in software if you think about it :-). But does sound more like queue than most things
or a stack!
Yeah this is just a queue system, lots of agent versions of these already. There’s nothing special about agents that they need their own queue system