HN
Hacker News
Top
New
Best
Ask
Show
Jobs
Comment by YetAnotherNick | Hacker News Reader
Parent
Full thread
YetAnotherNick
·
Or you could get A6000 for $4k with 48 GB VRAM.
View on HN
moonchrome
·
Is 48GB enough to run 70B models ?
sacred_numbers
·
Yes, with 4 bit quantization.
Reply on news.ycombinator.com