You can use kubernetes to manage bare metal machines, but it probably doesn't make much difference: once the bits are on the GPU, I doubt a properly configured VM is getting in the way, let alone containerd.
But even if we set that aside you’ll get access to your data over a network connection because these are expensive nodes running batch jobs with finite disk space, not personal workstations.