HN
Hacker News
Top
New
Best
Ask
Show
Jobs
Comment by lostmsu | Hacker News Reader
Parent
Full thread
lostmsu
·
What's the context length?
View on HN
dulakian
·
The model has a context of 131,072, but I only have 48G of VRAM so I run it with a context of 32768.
Reply on news.ycombinator.com