Hacker News Reader

The 1080ti is out there for almost 10 years now. It has 11GB of VRAM. A 5090 has 32GB.

SOCs with unified memory have shifted this a bit forward, but they're also expensive as shit.

10TB ram in a consumer device is simply not happening in the next 10 years.

Half a year ago you could get a AI max 395+ with 128GB ram in mobile form factor for ~$2200. The same thing costs $3700. Same SoC, same memory.

10TB is about 80 times that, 200K in today’s money. A lot of capacity is coming online in the next 5 years and it’s reasonable to think we can get there with better process and stacking (the latter does little for pricing, but enables shorter latencies).

> A lot of capacity is coming online in the next 5 years

Is this true though? I don't really have time to do the research and have no dog in the race but I'm sceptical...

But then again I'm not there one making our profiting from the claims that there is billions being invested into infra...

Reply on news.ycombinator.com