HN
Hacker News
Top
New
Best
Ask
Show
Jobs
Comment by zftnb666 | Hacker News Reader
Full thread
zftnb666
·
"Slow computer" + running a 200B model = "I'll just wait a week."
View on HN
tarruda
·
Assuming steady 1 tok/second generation (which seems to be the case for M5 Max macbook), wait 1 day for a 86400 token response. In some configurations it can be as slow as 0.1 tok/s, so be prepared to wait for 10 days.
Reply on news.ycombinator.com