Show HN: Self-hosted OpenAI api server for open source LLMs

github.com

2 pointsgaocegege3 comments

I can see many use cases for this work:

1. Plug and play. Change LLMs behind the app.

2. Evaluate performance/accuracy based on a dataset.

I checked your website and pricing link is not working.

We are still working on the price page. Will keep you sync!

FYI

Now we updated the pricing page: https://modelz.ai/pricing