994 karma · joined September 1, 2015
https://orcabot.com https://summer.ai https://talkito.com
contact: rob at ^ the first one
meet.hn/city/uk-London
Socials: - linkedin.com/in/romacrae
Interests: AI/ML, Entrepreneurship, Hacking, Gaming, Music, Programming, Research, Robotics, Sports, Technology, AR/VR
---
Can I get your review/roast on my approach with OrcaBot.com? DM me if I can incentivize you.. Code is available:
https://github.com/Hyper-Int/OrcaBot
enveil = encrypt-at-rest, decrypt-into-env-vars and hope the process doesn't look.
Orcabot = secrets never enter the LLM's process at all. The broker is a separate process that acts as a credential-injecting reverse proxy. The LLM's SDK thinks it's talking to localhost (the broker adds the real auth header and forwards to the real API). The secret crosses a process boundary that the LLM cannot reach.
The problem with the current model is that there is a high barrier to justifying the user pays essentially a 2nd/3rd subscription for ultimately the same AI intelligence layer. And so you cannot currently make an economically successful small use case app based on AI without somehow restricting users use of AI. I don't think AI companies are incentivized to fix this.
EDIT: also to be clear whisper doesn't run or even download the model unless it's selected and the user confirms the DL. This can be configured. Google cloud has a free ASR option and ASR can be switched off completely.
So essentially at present when you setup TalkiTo with a Slack bot (instructions are shown by running `talkito --setup-slack`) it will do this its just its sending all the output to slack not just the final completion. I have verbosity levels and I could try tweaking them so that -verbosity 0 essentially does what you want ie filter everything except for prompts to the user. If you put in an issue on GitHub I'll get to it!
[0]: https://www.aao.org/newsroom/news-releases/detail/do-glp-1-d...
Researcher: “with this new device we think we can attempt to create a gravity wave in the lab” Professor: “we should consider whether this might violate the 2028 embargo on dark forest beacon technology”
talkito: http://127.0.0.1:8000/sse (SSE)
https://github.com/robdmac/talkito/blob/main/talkito/mcp.py
Admittedly that's not as straight forward as one might hope.
Also regarding this point "letting you easily connect to your own Agents SDK MCP servers deployed in their cloud" I hear roocode has a cool new remote connect to your local machine so you can interact with roocode on your desktop from any browser.
This looks like exactly what I was envisioning so congrats on getting out there first! LMK if you want to add voice controls to this.
[0]: https://github.com/robdmac/talkito
[1]: https://talkito.com
So whats the benefit? Well for Claude Code this wrapper effectively bridges those TTS/ASR systems and CC so the voice interface is now there (CC doesn't have one). It doesn't just rely on MCP either (although it does start an MCP server for configuring via prompting) but instead directly injects the ASR and directly reads out CC's output when on.
It is free and open source so folks can inspect it and check it's not doing anything nefarious, so that others can contribute if they should choose. And the license is what it is as that seems to be the advice on this forum if you want to make sure a company can't just make a paid service out of your work.
With Claude Code I really like being able to multi-task but right now it's a bit like a Tesla on autopilot needing your hands still on the wheel. With TalkiTo I can do housework/go out for lunch and keep it on the right track remotely.