HN
Hacker News
Top
New
Best
Ask
Show
Jobs
Comment by arpowers | Hacker News Reader
Parent
Full thread
arpowers
·
Really takes that much vram??
View on HN
ioedward
·
Normally people split up the model across multiple GPUs, i.e. model/tensor parallelism.
Reply on news.ycombinator.com