Upfront, training costs 1000x more than inference - about 0.01/token vs 0.01/1000 tokens. But considering the user base size and the size of the training set - 15T tokens for GPT-4, I estimate the total inference cost becomes equal to training at around 10K tokens/user/month and 100M users.