Nvidia not name products after existing things in the ML space challenge: IMPOSSIBLE

More seriously, though:

> OpenAI Compatible Frontend – High performance OpenAI compatible http api server written in Rust.

Is this normal in this space? I know everyone has settled on copying the S3 API for block storage but I’m unsure if we’ve done the same for LLM serving.