Hacker News Reader

It's crazy. In a few years we will be able to buy Qwen on a chip, doing 10K tokens per second.

Yeah, well might just come on your new laptop

Or your phone.

Hopefully not vendor locked with pay-per-token licensing.