I was wondering, any way to use it with distributed systems for data analytics?

Imagine a set of workers that ingest data in parallel, would that work?

Currently it's pretty simple and i am spawning a process within the worker so it reads some stuff such as memory usage, cpu usage etc... But I would like to improve it.