Is it hard? Always? If it is so hard then why is it around. How would you go about parallelizing even mildly CPU heavy work loads on node.js?

Node.js and the like are awesome, but only if you have no blocking calls and your CPU usage is tiny. Otherwise you get the performance of a single threaded server. You know, because that's what it is.