All four times was an exercise in a lot of googling, hacking configurations,etc. Sadly it was always too much work and I eventually gave up.
Hopefully one day the experience is seamless and I never have to go back to Ubuntu.
Which is really the largest drawback by far that I've found. GNOME 4 is user-hostile garbage made by people who really really wish they were designing for tablets. It's practically useless without third-party extensions, which are of course unsupported. It doesn't even have a system tray FFS.
If Fedora Kinoite worked as well as Fedora Silverblue, I think I could be reasonably content. Immutable base system with Flatpak and Toolboxes is pretty close to how I actually want a system to work.
But while we're on the topic of user hostility, I'm not really a fan of some of the changes the Gnome devs are doing either, so I may switch again in the future but at least for now I'm comfortable using it and they aren't outright antagonizing my system like Ubuntu does with snaps.
Things like hiDPI support go funny, but that's just Linux for you.
For example I just installed Fedora 35, I will probably install 36 at some point after 37 comes out, and stay one release behind current. Major upgrades are still relatively safe because of FS snapshots. I just personally prefer a slightly slower pace than “bleeding edge all the time”.
For a server I would just put Alma/Rocky Linux on it.
Also, in general the upgrades are quite reliable. I have a few systems that have been upgraded in-place for years without any issues (regardless of snapshots, since they're using ext4).