I think the real challenge is internationalization - it would be a challenge to build GPT-N like models for all the other languages, that work as well as the original one.
Interesting if Google will roll it's own language model for that purpose. Is it possible, that we might get several language models, each one for a specific category of users, or would that approach lead to a loss in generality/quality?