The Hard Parts of Streaming Audio in Voice Agents
Blog: https://gokuljs.com/blogs/when-latency-becomes-audible
code: https://github.com/gokuljs/GoSFU
code: https://github.com/gokuljs/GoSFU
I also open sourced the project. There are some interesting infrastructure issues in the repo that might be worth a look.