Regarding multiprocessing and serializing between processes in python, and linux specifically, have you tried SharredArray?

It dumps numpy arrays in /dev/shm which can loaded by other processes by the filepath, muuuuuch nicer than passing things around