You either do local inference or get Azure OpenAI to have your own private gpt-4o or whatever. :)