Why not use a local model instead of relying on OpenAI? Even something like Mistral or Mytholite will probably satisfy 90% of people using your app, and I bet hosting it would be cheaper than GPT anyway.