Hacker News Reader

I think it will be quite a few years before an LLM is built into their silicon.

But I do see a Neural Engine 2.0 in the future that will better handle these things in the more near term future.

iirc creating new ml optimized chips/chiplets was part of the appeal for risc-v right? Is risc-v relevant yet, or are there any promising risc-v chips on the way? I know there's a lot of hype around them, so i'm curious to know how much is just noise or what the real sentiment is from the experts/industry.

I've been looking into this. The great thing is riscv isa is free to license and customize. There's opportunity for efficient inference at the edge. If anyone is interested in working on this together, send me a private message.

Reply on news.ycombinator.com