Don't forget about the (awesome) cluster scheduler, Flux.

https://hpc-tutorials.llnl.gov/flux/