I had this problem on Fedora and my RTX 3090. Never got to the bottom of it.