Hacker News Reader

What's GPU-5?

The fattest quantization. They show all of them here: https://huggingface.co/byteshape/Qwen3.8-27B-GGUF

Since they’re not using a stable number of bits per token, they use their own naming convention.

> they use their own naming convention.

Seems like a lot of them do, I only compare them within the same repo because there doesn't seem to be a very standard way of saying all the possible combinations/rearrangements.

bpw is the way to compare. huggingface has standard tags that must be used so it forces anyone releasing models to choose a tag that doesn't necessarily equal the actual bpw.

It's a bad way to compare. Average bpw ignores the fact that some layers can tolerate more aggressive quant than others.

Reply on news.ycombinator.com