Something I've only read up on so far but has me optimistic: http://www.pachyderm.io it will do data versioning and keep track of how intermediate results get produced.