You don't have to quantize all layers and all dimensions uniformly, FWIW