I guess I don't understand what this is now. If its just proxying requests and storing in db, can't it be literally any API?
We could support any API. We’re focused on building data pipelines and tooling for LLM use cases.
We already support OpenAI and Anthropic endpoints, and can add models/endpoints quickly based on your requirements. We plan to expand to Llama and other self-hosted models soon. Do you have a specific model you want supported?