It would work great if NVIDIA, AMD and Intel made high end consumer GPU's that could be shared between host and guest. So far we can only share Intel iGPU's - at least on paper, because I haven't managed to make it work.
... Or hack NVIDIA gpu's and potentially brick your 2000$ card...