Here people discuss that for a chaotic system automatic differentiation will diverge. https://discourse.julialang.org/t/when-forwarddiff-ing-throu...
I'm trying to come up with a simple example. I think that for bunch of flying hard spheres in a box, any measurement that requires sufficiently time spaced samples of their positions will have trouble being differentiated.