setting this up isn't nearly as hard as you think take dask everything is simple and all the k8s setup has been done for you.