Hacker News Reader

Comment by throwaway5959 | Hacker News Reader

4060 Ti w/16 GB seems like a sweet spot for machine learning hobbyists. Only bummer from what I can see is the 128 bit bus.

View on HN

> The $399 RTX 4060 Ti will ship on May 24th with just 8GB of VRAM, while a 16GB model is due in July priced at $499.

Is that accurate?

It seems!

I think the more amazing thing is the "only" 165 W power draw for the 4060 Ti. Although, given marketing these days, I am sure that number is lying, but I am still happy to see something reasonable. The 4090 is listed with a TDP of 450W.

Unless a better option comes out in the next few months, I might pick one up. It seemed a bit pointless to upgrade to anything below 16 GB, and up until now that meant a 3090 or 4090. And the prices for those are pretty steep for hobbyist use.

AMD's 6800XT should be a pretty good competitor to it; 500 bucks, 16GB vram, and a 256 bit bus. And the 6800XT is already available

Good luck with the software

Why? Buggy drivers? No CUDA?

No CUDA.

ROCm is a thing, though (but not on Windows.)

Don't forget about the Intel Arc A770. 16GB VRAM, 256bit bus for $350. Can use OneAPI for machine learning too.

I don’t think that’s enough, cloud solutions are still cheaper and faster I believe

Gaming class GPU's provide much better $/FLOPS (ie a 4090 is ~5x better value than a H100)

https://timdettmers.com/2023/01/30/which-gpu-for-deep-learni...

Nvidia forces corporations to buy datacenter GPU's for CUDA licensing reasons, and adds a significant margin on top.

this is not a 4090 and even then your article mentions experiments are better on a cloud solution. Where they only recommend getting a top of the line GPU if you are doing longer than a year work

I unfortunately don’t have $2000 to spend on a GPU. Would be nice though.

How big of a factor is the 128 bit bus?

*60 TI always seems to be a nice mid-market pick.

The mac mini comes with 32GB

Nowhere near the same computation for floating point.

Reply on news.ycombinator.com