Intriguing option but I'm dealing with the integrated GPU here. It looks like TensorFlow is for NVidia discrete GPUs.
PythonOpenCL is probably the best option: https://mathema.tician.de/software/pyopencl/
One thing about integrated GPUs for server is that there's no transfer time, since the GPUs share memory with the CPU.