992 karma · joined September 1, 2015
https://orcabot.com https://summer.ai https://talkito.com
contact: rob at ^ the first one
meet.hn/city/uk-London
Socials: - linkedin.com/in/romacrae
Interests: AI/ML, Entrepreneurship, Hacking, Gaming, Music, Programming, Research, Robotics, Sports, Technology, AR/VR
---
It's been out for 6 months.
Still shoring up the details but you can try a sample of all the options and see how they compare in terms of model size, peak RSS, real time factor etc.
I’ve been integrating benchmarks into OrcaBot either locally on the app or online at orcabot.com. Mostly as a way of giving an easy way to verify my own posted benchmarks. There is a template for running SlopCodeBench. Working on a TTS one next.
Wasn’t sure if there would be a lot of interest in this space. It can be costly but some provided such as OpenAI let you hammer their subscription with these.
Source available: https://github.com/Hyper-Int/OrcaBot
I’ve used SCB as part of my assessment of agent skills (superpowers, GSD etc) https://orcabot.com/labs/do-skills-improve-coding-agent-accu...
There is a small but growing community on discord for discussing SCB so if interested please join https://discord.gg/BrC4BA9sVj
But with regard to Juggler and orchestration, have you seen "claude agents" (started in the terminal as claude agents instead of just claude). I ask because your tree like approach has similarities to how claude agents manages claude agents/subagents doing tasks with the ability to drill down in to each at a time which is why for me its not such a leap from what you already have.
I've got my own attempt with OrcaBot (short for orchestration of bots). It's also been a 6 month solo build experiment. I'm not trying to plug.. just that I'm also neck deep in Steve Yegge's Stage 8 AI-assisted coding chart and understand how much thought and effort went into this.
Thinking about where this is all going with talking to AI like fully autonomous employees similar to @Claude can you see a comms app type approach that combines something like slack with your tree/thread structure? It's somewhat orthogonal to your "inspect everything" but could intersect by bringing click through/open in options...
OrcaBot was my Jan+Feb attempt to defeat the lethal trifecta whilst offering all the bells and whistles of a claw like sandbox: https://orcabot.com/blog#breaking-the-lethal-trifecta
This month I've been working on the free desktop version which is available as of today but probably carries a few too many bugs to not be worth promoting just yet.
Comparing with MSFT and AAPL makes TSLA look even more insane.
Domain fronting and Steganography in commits to public repos are not solved and probably in all honesty not completely solvable. I wonder if this well end up like in banking where no bank can completely eliminate fraud. I've got some ideas to do bank like fraud detection within OrcaBot now so might be able to limit the impact a little. Thank you!
So everyone acts as a sort of beta tester for obscure posts.
A figma like dashboard for turning ClaudeCode, Gemini Cli, Codex into an OpenClaw but with security measures to break the lethal trifecta while running on a VM.
But it's not quite there in terms of usability. I agree that is the hardest part of the equation. It's something I'm constantly experimenting with and haven't found the solution to it yet. Open to feedback!
And this seems very much in line with the methodology in ARC-AGI-3.
The results here, in the OP article and in https://www.designarena.ai all tell a similar story: Kimi K2.6 is up and in the SOTA mix.
Really interesting article though. I’m very hopeful AI can help work out how all these things interact.
There are many studies a quick google away that show a much more nuanced take ie [0] and [1]. But the strongest evidence is our most successful societies and civilizations have been intentionally drinking alcohol for ~10000 years [2]. If it was only detrimental then I'm pretty sure it would have worked its way out by now. I acknowledge there are negative issues.
[0]: https://www.webmd.com/diet/ss/slideshow-skinny-cocktails [1]: https://nutritionsource.hsph.harvard.edu/healthy-drinks/drin... [2]: https://en.wikipedia.org/wiki/History_of_alcoholic_beverages