A tale of two flows: Metaflow and Kubeflow

I work with workflows and HPC, and the most common is multiple workflow managers in an hpc center, or even within a department. Which is not always necessary (sometimes it feels like just because there is budget and someone skilled they prefer to reinvent than reuse).

I hope this means that trend is stopping.

Another thing I hope I will start seeing more are workflow managers sharing libraries. Most workflow managers need to handle similar tasks like submitting tasks to cloud, slurm, containers. Or even performing graph operations, visualizing graphs.