Hacker News Reader

Nope. You can run local LLMs on a 5060 Ti. No need for a 40k GPU.

I read that as "you really don't" need rich friends to buy a H200. I see what you meant now. Sorry about that. The shit you hear people say in SV sometimes is wild.

I run them on my 5070. They're moderately useful at that scale I guess.

Reply on news.ycombinator.com