ParentFull threadjjssmith·You might like an information-theoretic take on SpinQuant and the likes [1].tl;dr: round((2*R)*x) is not a great idea for an R-bit quantization.[1] https://arxiv.org/abs/2410.13780View on HN