We experienced similar challenges. That’s why we made audio handling, turn detection, and LLM retries modular. You can swap models or providers as needed.
GitHub: https://github.com/videosdk-live/agents
Blog: https://www.videosdk.live/blog/ai-telephony-agent-inbound-ou...