HN
Hacker News
Top
New
Best
Ask
Show
Jobs
Comment by thellimist | Hacker News Reader
Parent
Full thread
thellimist
·
What do you mean?
View on HN
hiccuphippo
·
The article says the LLM has to load 15540 tokens every time, I wonder if that can be reduced while retaining the context maybe with deduplications, removing superfluous words, using shorter expressions with the same meaning or things like that.
Reply on news.ycombinator.com