Have you noticed a gap between 8bit and 4bit quant? I've always ran 4bit quant cause less memory required
I find gemini/gemma to have become worse at coding, they are better for non-coding tasks, but maybe not even that, the hallucinations and instruction following have both degraded ime