I'm running 30b quant on my 3090. that many 4bits fortunately fit into my precious vram