Cognition (Devin) raises $2B at $48B valuation
cognition.com
cognition.com
I mean ChatGPT is the harness most of the time that's calling the tools, MCPs, etc. Putting a loop around it doesn't really seem like it would be something that gets you a lot of extra milage.
Look at how Astra scored 100% on Arc-AGI-3. It was largely because of the harness.
The harness increases the chances (often to 100% chance) of a non-deterministic LLM to perform deterministic actions.
Not only that, the harness provides the feedback that becomes training data for the model. So, over time the model bakes those lessons in, and the harness becomes less necessary and the agent becomes more efficient at some tasks.
A harness will likely always be necessary, we may hit some level of complexity or some level of compute that never allows us to bake the lessons into the model, and external tools provide the model with the ability to find leverage and make up for those short comings.
Astra didn't solve Arc-AGI-3 because of its phenomenal harness, just a harness was needed to support its capabilities.
Giving Astra's harness to a different LLM would not have improved said LLMs ability to solve the task in a meaningful way.
I feel like this is important to point out, seeing how I'm commenting under an article about how a harness is valued at $50B.
Imagine valuing a JSON parser at $50B on the basis that most communication can't be read without one.
Edit 48billion I just noticed. Someone’s getting fleeced.