Hacker News Reader

Incredible! The march continues to get more models to run on the edge, much faster than I anticipated. The static quantization and slicing techniques here are pretty cool

View on HN

I’ve been amazed at how quickly the open source community has iterated on LLMs and Diffusion models. Goes to show how well open source can work.

Innovation in the tech world is spurred by open access.

Support the open companies. Avoid the closed ones, even if they are fantastic at marketing. ;)

Reply on news.ycombinator.com