Show HN: Model Gateway and LLM Guardrails with OpenAI SDK
github.com
We've updated our model gateway + guardrail tool called `optimodel` to use the on the OpenAI SDK primarily on the client side.
Now with a few lines changed you can instantly get access to 25+ model along with LLM guardrails like Llama prompt guard or Microsofts PII guard. All with the same OpenAI interface, no changes to your code.
We hope this will make it easier for developers to try out new models with ease along with setting up LLM guardrails with little changes to your code
We also have some fun features like fallback support to defer to other models if a provider is down, speed priority to choose the provider thats the cheapest regardless of speed, and more!
We'd love feedback on this to see if it can help others!
You can find the project here: https://github.com/Lytix-Labs/optimodel/tree/master