[Ask HN] From days to minutes by using Dask and Spark–what else should I learn?

I often find myself having to wait up to multiple hours (in one case days) waiting for an ML model to train or to tune some hyper parameters. I recently discovered Dask and with small changes to my Python code I saved many hours of compute. I only wish I knew about it sooner.

Does anyone else spend hours waiting for their computation to run? If yes, I'd love to

Know which tasks are the most time-consuming for you (in terms of waiting for CPU to finish)

Learn how you deal with large datasets when doing distributed computing

Feel free to comment below or message me if you'd like to share tips, links etc. I feel like a noob for not knowing about it until now and am afraid I might be missing other important use cases / tools etc. Any and all feedback is appreciated!