New SOTA 4-bit weight and KV quantization with optimized GPU performancearxiv.org3 points·Hugsun··0 commentsOpen articleSaveView on HN