HN
Hacker News
Top
New
Best
Ask
Show
Jobs
Comment by getcrunk | Hacker News Reader
Full thread
getcrunk
·
Anyone compare this to ternary bonsai vs the 1 bit
View on HN
woadwarrior01
·
I haven't compared it for perf, but at first glance this appears to be an LLM (text-only) while both binary and ternary bonsai 27B models are VLMs (where the vision tower and the adapter MLP weights are unquantized and kept in float16).
Reply on news.ycombinator.com