Ah, wait:
https://github.com/madeden/blogposts/blob/master/k8s-gpu-clo...
You don't need to mount the /dev entries into the container at all. The experimental support creates them automatically for you when you are using GPU resources. Perhaps it's device nodes, not the libraries that required privileges?