Amazon did release a 20B transformer called Alexa last year: https://www.amazon.science/blog/20b-parameter-alexa-model-se...