I would think there has to be some decent middle ground like storing some structures on disk mmap'd and letting the kernel handle back pressure and caching
So I don't deny the idea, just stating that it's probably _significantly_ more complex to implement than it sounds.