HN
Hacker News
Top
New
Best
Ask
Show
Jobs
Comment by moonchrome | Hacker News Reader
Parent
Full thread
moonchrome
·
Is 48GB enough to run 70B models ?
View on HN
sacred_numbers
·
Yes, with 4 bit quantization.
Reply on news.ycombinator.com