No, their revised understanding is more accurate. The model has internal representations of concepts; the seahorse emoji fails because it uses those representations and stumbles: https://vgel.me/posts/seahorse/
https://www.analyticsvidhya.com/blog/2021/07/word2vec-for-wo...
A markov chain presents the same representation in a lower vector space.