What would be cool is if we could run some kind of jobs in a docker container on those instances with the nvidia drivers pre-installed.

What I mean is I prepare a container, I go to tensordock and start my container with some parameter. Tensordock prepares an instance in the background for me, run the container and stop the instance once the container stop.