Not sure what this means - pytorch's autodiff is reverse mode accumulation. You can read pazschke's paper on it or just go look at the implementation.
it does look like a lot of progress has been made lately, but it isn't in a release yet: https://github.com/pytorch/pytorch/issues/10223