Hacker News Reader

Think you need to read up what transformers actually do (they refine syntactically, semantically and whatever additional way you wish) and what emergent properties they have.

View on HN

will look into emergent transformers again but I did take cs231n at Stanford and know wtf is up here

If it's of any help, it's the multi-head attention mechanism, one of the more unique characteristics (although it can be done in other NN's).

Reply on news.ycombinator.com