Hacker News Reader

It needs a mlx fork because the lowest bit in mlx is 2 currently (for affine quantization).

That mlx is for apple hardware only, though? Or did I misunderstand something.

It needs a llama.cpp fork, too; so the stock runtime (based on stock llama.cpp) used by LM Studio presumably won't work for it.