Hacker News Reader

I took the text of Macbeth and changed the dialect of one line:

Original: "The rest, that are within the note of expectation, alreadie are i'th' Court"

New: "It looks like everyone is here already"

Then I gave the entire text to Gemini, ~400000 tokens, and asked it to analyze the play's diction and style, and to identify any lines that didn't match the prevailing dialect.

It found that one line I'd changed.

View on HN

Isn’t it quite likely it already had the whole text from its training data? Which might make it a bit of a different case.

I was responding to the assertion that the "ability to compare within-context dramatically declines with large context".

My test demonstrates that even with a large context, Gemini 1.5 finds the needle in the haystack.

And it's not even searching for specific terms or meanings, the only clues are subtle differences in style and diction.

Reply on news.ycombinator.com