Hacker News Reader

We cantnrun local models on them? They must have some sort of api exposed right? Qualcomm has the Snapdragon Neural Processing Engine iirc

View on HN

You can do cool experiments with them. But nothing a typical consumer is likely to care about.

Yes, you can. Of course relatively limited, but you absolutely can run local models.

Based on my own testing, the Windows drivers are a bit restricted to do some more advanced stuff, and it may be due to some security issues in the past? at least that is what I gathered from exploring this issue with GLM 5.3

Reply on news.ycombinator.com