Hacker News Reader

I think you've fixed it! I just tested it, now it works. (In both Chrome on Windows with NVidia 1060 gpu w/ 6 GB vram, which is what it wasn't working on yesterday, and on Safari on 2026 Mac Mini M4 with 24 GB of RAM. The former is pretty slow, around 1 tok/sec, the latter is fast at 18 tok/sec.)

View on HN

Yeah, I found a bug during model load occurring with Firefox and low VRAM machines. It is fixed now, thanks!

The 1060 is unusually slow. The Mac mini sounds about right. Have fun playing around and sharing. With the more VRAM of the mini you can also run Qwen 3.8 27b :)

I really like to showcase this to non-tech people to show what their home machines already can do WITHOUT INSTALLATION in an air-gapped scenario! And given all the recent fuss, we should not trust the big providers at all with important data.

Great, thank you for making it and also the fixes!

Reply on news.ycombinator.com