you can plugin your existing stack and use it via an openai compatible client.

https://www.mixedbread.com/docs/agent/chat-completions