Hacker News Reader

Those are really nice numbers. With that t/s, no network latency or queueing it must feel much snappier than cloud models.

View on HN

it is, unless it set to xhigh - it really likes generating tons of tokens for its thinking. unfortunately, for decently reliable coding results you want it on xhigh ...

Reply on news.ycombinator.com