They could literally run Mixtral or Llama on their own machines and have total control. This is basically a ChatGPT VPN.
Either use one of the many open models that beat GPT-3.5 and you have a real, and better!, product.
I literally have no idea what the point of this is, or why not make the actual step of rolling out a real private LLM. It’s literally inferior to what Mixtral provides right now, under Apache license.