It helps of course that English is the de facto lingua franca of most of the technologically developed world (if not the rest of the world also). If another language was the lingua franca, current approaches would not work so well. The article makes a point about how we assume that pre-trained embeddings encode all relevant information about a language when this may not be the case for arbitrary languages. The article also makes a point about the morphological simplicity of English which is of course a great asset for a lingua franca, and also simplifies the language modelling task. Imagine if the lingua franca was, e.g. ancient Greek (as it was, in ancient times, all around the Mediterrannean) or something with similar morphological intricacies (and Greek is still an Indo-European language; I just don't know much about, e.g. Finno-Ugric to give an example about them).