I don’t find that to be particularly systematic because it’s still so haphazard. It’s like asking Claude to vibe code you a website.
I was mostly highlighting the sheer cost of systematically exploring it. 60 agents doing something very narrow with a domain expert navigating the slop is already a high cost but I can see it being done more often in the near future since it just wasn’t possible a few years ago.
Ah, yeah that's a fair point. I was thinking it'd be something the labs themselves, or other companies with billions of dollars in funding, would tackle. The labs seemingly have the most to gain since such a system could be used for recursive self improvement.