Hacker News Reader

The matmul stuff is part of the Neural Accelerator marketing, which is distinct from the Neural Engine you're talking about.

I don't blame you. It's confusing.

View on HN

It's remaining and rearrangement of the same stuff. Not a new feature.

1. It adds new features. Eg. see matmul and other to-be-detailed-soon features.

2. It moves some stuff from the external Neural Engine to the GPU, which substantially increases speeds for those workloads. That itself is a feature.

Will any of this really matter much to the average consumer at this point? Probably not. Not until Apple Intelligence gets off the ground.

The NPU is still there. This adds matmul acceleration directly into each GPU core. It takes about ~10% more transistors to add these accelerators into the GPU so it's a significant investment for Apple.

Reply on news.ycombinator.com