When are you actually billed?
First, when you create embeddings at the beginning. Second, every time you call the OpenAI chat complete API?
You can use local embeddings, such as sentence transformer models, too, to save on embeddings (and maintain embeddings you can move to another provider with new queries etc)