It's MOSTLY painless. Some GNOME extensions seem to randomly hang everything on startup (I'm currently investigating which ones, I believe Dash to Dock and/or Unite are to blame) and there's a weird issue with VR when streaming via ALVR: SteamVR launches, but games crash unless I disable the second monitor (no such issues with WiVRn, so not entirely sure if it's a driver problem or not)

Besides that in my daily driving I saw no other issues.

I'm convinced that many these people saying Nvidia has serious issues on Linux must be (by no fault of their own) going by habit and downloading the driver installer .bin from the Nvidia website and trying to install drivers that way. So yes, if you do that you're going to have issues.

Learn to do things the way your distro does them (use a package manager) and most problems go away.