Doesn't python have fork with copy-on-write semantics?
Doesn't python have fork with copy-on-write semantics?
Check the man pages for fork(2) and vfork(2) for fork related COW information. There's some interesting stuff in there.
As a side note, there's an interesting write-up on the portability of fork between UNIX and win32 in the perlfork man page (forgive me for mentioning perl in a python related thread), and the hoops that needed to be jumped through to emulate fork on win32 and keep it compatible with real fork from the visibility of the perl script itself.
What we've done is mmaping multi-gb files into memory by separate processes. It works, but it's a cumbersome workaround which makes you do way more work than you would ever wish to be able to use multiple cores.