Hacker News Reader

Comment by canjobear | Hacker News Reader

Much simpler models like word2vec also showed linear embeddings of geography in this way.

source?

It was something like

    Paris - France + Japan = Tokyo

I know that's not a source but you could also just google "word2vec", as I recall most of the explainer blog posts had similar examples.

So it's good at SAT type questions?

It's not "good" at anything, it's a set of word embeddings. You have to apply them in some context using a feedforward model of some sort for them to be used in some task.

That gets "analogies" rather than "spatial awareness" per-se.

You put quotes around spatial awareness but the commenter being referenced said geography.

Reply on news.ycombinator.com