ParentFull threadyassa9·what quantization did u try ? u can use Q4 quantization, im pretty sure that 48GB would be enoughView on HN