Yes, sooner or later this is going to become the future of GPT in applications. The models are going to be embedded directly within the applications.
I'm hoping for more progress in the performance of vectorized computing so that both model training and usage can become cheaper. If that happens, I am hopeful we are going to see a lot of open source models that can embedded into the applications.