There already are tons of open source models. Some of them good. Check out Huggingface. BLOOM comes to mind as a decent starting point.
A part of me hopes they are able to use money Google gives them for some of this - although that may be reserved for just Firefox.