Hacker News Reader

I would guess that semantic similarity would be the stronger training signal than distance once you go beyond a sentence or two away.

View on HN

I'm pretty dubious - how would the model not get absolutely swamped by the vast amount of potential context if it's not learning to ignore long range signals for the most part?

Reply on news.ycombinator.com