KianHooshmand

Vocode || Engineering (multiple roles) || SF/Remote || Full-time/Contract || https://vocode.dev We (Vocode) empower developers to connect the world with magical conversational AI experiences. Our hosted APIs and open source repo are used by thousands of engineers to create transformative experiences for customers around the world.

Backed by YC (W23), Google Ventures, Base10, and Gradient Ventures and some fantastic angels!

Details on openings here: https://vocode.notion.site/Vocode-Careers-47f27748419d48f9bc...

If interested, please reach out to hiring@vocode.dev!

Vocode || Engineering (multiple roles) || SF/Remote || Full-time/Contract || https://vocode.dev

We (Vocode) empower developers to connect the world with magical conversational AI experiences. Our hosted APIs and open source repo are used by thousands of engineers to create transformative experiences for customers around the world.

Backed by YC (W23), Google Ventures, Base10, and Gradient Ventures and some fantastic angels!

Details on openings here: https://www.notion.so/vocode/Vocode-Careers-47f27748419d48f9...

If interested, please reach out to hiring@vocode.dev!

In the main post! It's +1-650-729-9536 :)

Yes! Give it a try on the phone call and let us know what you think – would love feedback!

thank you! All credit to Rime for the Gen Z voice :)

Yep. We are working on adding more integrations (and want to have a full self hosted stack)... we're open to contributors and help from the community if there's something you'd like to see added!

We just got a PR for adding Coqui TTS which is open source – should get it merged soon :)

absolutely! you can just plug in your own LLM... so it can be trained on anything you like and the library will make it voice-based!

Thank you for the feedback!

Actually it can be configured to use any transcriber you like... Twilio just pipes the audio to us and we can use any of our integrations (Deepgram, Whisper, AssemblyAI, Google Cloud, etc.) for the ASR :)

totally agree! this is a really cool use case :)

We chunk it up per sentence so it has some context!

Lily is epic. Highly recommend checking out Rime when it's available!!

Totally! We actually use LangChain for the OpenAI wrapper agents we give out of the box (you can plug in your own custom one as well)

thank you!

We definitely want to do this! We've been talking about it (it's much better like you said for realtime); it's been hard to juggle everything we've wanted to add.. which is why we think this makes so much more sense open source!

We want the repo to be community built and a public good... would love contributors to start adding integrations we can't get to ourselves

Yep we're definitely getting a large volume right now – working on it!

Ah! Right now our default is set to use OpenAI... but you can actually use local LLMs by creating a custom agent. We're going to add a full stack of local STT/TTS/LLM... just haven't had time for it yet!

If anyone wants to help with it we're totally open for contributions :)

thank you! love your feedback and please feel free to drop any questions in discord/on github

thank you! it's not live right now... but stay tuned for april 1 :)

Thank you!! Really glad you enjoyed it

We actually have no clue... but it seems to be holding up well. We can scale up the CPU as necessary but not sure about Twilio. I guess we will find out!

We totally agree – thank you for the feedback! :)

thank you for the kind words! absolutely agree – we're gonna beef up our tutorials and documentation... just have had so much to do but it's definitely one of our focuses now. stay tuned! :)

yes! You can run the local version here in your bash https://docs.vocode.dev/python-quickstart#self-hosted

And yes! It's STT/LLM/TTS where you can choose between different providers and run it across different platforms. It can be turn based (like the demo you linked from twitter) or streaming (this allows for conversation with interruptions!)

Our belief is that at some point OpenAI will add a speech-to-speech model. This will improve the library functionality (since now the whole stack is controlled by a single entity, so the product will naturally be better latency/quality wise).

Our library is open source so that we can all build a development/utility layer on top of whatever foundational models are created. Plugins of course also improve what the agents can do. And right, we will be building enterprise focused products in the future!

Of course! We loved working on this and chose to open source precisely for this reason. Heavily inspired by the work people are doing on Langchain and providing a usability/developer layer on top of foundational models.

Nothing like this existed for voice so we started cranking on it!

We haven't added the ability to switch languages mid conversation... but that's a very cool feature!

You can configure the initial language with the library though! So it works across several languages that are supported by the STT/TTS providers you choose

Ah! Have not tried this but will look into it – thank you :)

Our docs are hosted on Mintlify