If you want to pass-through a consumer Nvidia card to a VM, you need to hide that you are running a VM from the guest OS, otherwise the Nvidia drivers will fail with some obscure errors.

https://github.com/sk1080/nvidia-kvm-patcher/blob/master/REA...