Hacker News Reader

> matmult would be in transformer-optimized hardware

It is... it's in GPUs lol

> first class in torch

It is

> costing a fraction of GPUs

Why would anyone give you this for cheaper than GPUs lol?

I think they’re referring to hardware like TPUs and other ASICs. Which also exist, of course :)

Sure but GPUs literally have MMA engines now