You should probably mention that embeddings are just a renaming of text vectors, aka vector space model, which have probably been used since before neural networks.