From my experience, the main pain point with Linux GPU drivers is for standard "desktop" tasks, like not breaking when Ubuntu switches to Wayland... A server designated for GPGPU applications just need the basic configuration to get the Nvidia toochain for CUDA up and running