See the classic of the genre, "Command-line Tools can be 235x Faster than your Hadoop Cluster"

https://adamdrake.com/command-line-tools-can-be-235x-faster-...