Six paragraphs in, and I already have questions.
> Hello -> [1,2,3,4] World -> [2,3,4,5]
The vectors are random, but they look like they have a pattern here. Does the 2 in both vector mean something? Or, is it the entire set that makes it unique?
> Hello -> [1,2,3,4] World -> [2,3,4,5]
The vectors are random, but they look like they have a pattern here. Does the 2 in both vector mean something? Or, is it the entire set that makes it unique?
That the numbers are reused isn’t meaningful here: a 1 in the first position is quite unrelated to a 1 in the second (as no convolutions are done over this vector)
A good place to start on that topic is the word2vec paper.