Google certainly appear to be a bit behind, although it's hard to know what they have internally that they've chosen not to release.
It seems that Google have certainly been cautious about releasing this type of tech, but again hard to tell the exact mix of motivations - e.g. safety vs business risks. Almost all the authors of the Transformer paper have since left Google, and it seems a common theme is that they all thought Google was under-utilizing the tech - maybe just not knowing what to do with it as much as being worried about it ?
It seems things are now changing at Google, with the Brain + DeepMind merger and what appears to be a new productization focus. It seems competition may now be trumping safety concerns, even if they are still paying lip service to it!