Hacker News Reader

I’ve been running it via llama-server with no issues. Running the latest Bartowski 6-bit quant

Bartowski? Like Chuck Bartowski from the TV show?

Different one. Bartowski is a minor celebrity in the local LLM world, together with Unsloth.

What's the selling point of these quants vs the Unsloth ones?

Sometimes unsloth has broken ones for a particular model, sometimes no quants at all, and there is subtle difference in behavior.

Thanks, i'll check his quants.