One tradeoff of bringing your own API keys is that as you add more model providers, you get more billing accounts to deal with. Chorus also doesn't have an incentive to efficiently use your tokens. We save 67% on Anthropic token costs using Claude Caching. We also use cheaper "task models" for conversation titles, tagging, and parts of the RAG pipeline which all drastically cuts token costs.

For local models I highly recommend https://github.com/crizCraig/open-webui

They do the side by side thing that Chorus does and you can serve it to anywhere including your phone.