Google's Gemma to run locally on Nvidia GPUs

I've quantised 2B & 7B Instruct models here https://huggingface.co/iAkashPaul/gemma-2b-it-gguf & https://huggingface.co/iAkashPaul/gemma-7b-it-gguf

How does this compare to Mixtral (especially the Dolphin and Orca fine tunes)?

I'm assuming it won't run on my GPU though since I am a white man