Hacker News Reader

Your limitation after prefill is memory bandwidth. A maxed out Studio has less than a single 3090 (really).

Yeah, the 3090 has faster memory, but not by a lot.

The 5090 is at 1,792GB/sec and potential M5 Ultra would be 1,230GB/sec and 512GB RAM. Maybe 1TB. Not 32.

You’re suggesting that a difference of the entirety of the M5 Max’s bandwidth is an insignificant gap!

No, that difference is the 5090, not the 3090.