Well, its that easy if you can live with slightly old version. There is CUDA package in official repo IIRC.
I'm not 100% sure but I also think that by installing the nvidia-cuda-toolkit package it leaves out the CUDA samples. These contain the deviceQuery and bandwidthTest scripts necessary to check that CUDA is functional.
Admittedly I have two consumer cards in SLI, so that may have affected the install. It could also have been incompatibility between the actual Nvidia display drivers and the various dependencies. It's a bit messy!