HN
Hacker News
Top
New
Best
Ask
Show
Jobs
Comment by jonrosner | Hacker News Reader
Parent
Full thread
jonrosner
·
running it on my M4 @ 90tps, takes 18GB of RAM.
View on HN
Tepix
·
If it uses 18GB of RAM, you're not using the official model (released in BF16 and FP8), but a quantization of unknown quality.
If you write "M4", you mean M4 and not M4 Pro or M4 Max?
pylotlight
·
M2 Max @ 17tps btw
Reply on news.ycombinator.com