44 karma · joined September 28, 2023
My original question was more along the lines of implementing things like PR review yourself. I was tinkering with an internal service that spins up ephemeral CC instances to analyze PRs, but realized this can easily generalize across arbitrary tasks. Was curious what sort of things folks could use that for.
> The only people who should not have kids are bad parents and people who don't want kids.
I don't think people who are highly susceptible to birthing malformed children should have children either. Genetic testing helps figure out if you might be in that group.
Largely agree with your point on preventative actions being the same with or without testing, but there is a tail end that might warrant specialized action.
> A natural reaction is to design a dynamic action space—perhaps loading tools on demand using something RAG-like. We tried that in Manus too. But our experiments suggest a clear rule: unless absolutely necessary, avoid dynamically adding or removing tools mid-iteration. There are two main reasons for this:
> 1. In most LLMs, tool definitions live near the front of the context after serialization, typically before or after the system prompt. So any change will invalidate the KV-cache for all subsequent actions and observations.
> 2. When previous actions and observations still refer to tools that are no longer defined in the current context, the model gets confused. Without constrained decoding, this often leads to schema violations or hallucinated actions.
> To solve this while still improving action selection, Manus uses a context-aware state machine to manage tool availability. Rather than removing tools, it masks the token logits during decoding to prevent (or enforce) the selection of certain actions based on the current context.
What percentage of the AI labs are staffed by either foreign workers or second/third generation immigrants? Look at the composition of high achieving high school students- almost certainly of Asian or Indian descent, certainly many belonging to families of recent immigrants. The pipeline this EO disrupts is immense.