Hacker News Reader

What do the 5xxx series cards have that this doesn't which makes them use way more power and need massive coolers?

I have a feeling the software workflows will not run as well as the marketing claims, but the idea is really interesting and in a few years I bet the workflow will be really smooth.

View on HN

Way more memory bandwidth and performance (GDDR7 vs LPDDR5). I didn't see fp32 detailed, but this may be more focused on low precision.

This is probably closer to quad-channel threadripper/second tier apple levels of bandwidth than to modern GPU bandwidth, but maybe it gets up to 800GB/s like the M1 Ultra. 5090 is 1.8GB/s, four of them for the same amount of RAM (3X as expensive with a system), would be 7200GB/s, maybe 10-20X more.

With the lower power consumption, if this has full performance FP32, it may be pretty killer though for home use, especially if the bandwidth of the ConnectX is more than thunderbolt 5.

Edit: LPDDR5X, I think that's 30% faster

The NIC that has matters, in addition to the very large memory that supports much larger models than a consumer GPU. This thing has a proper ConnectX NIC.

Reply on news.ycombinator.com