Second derivatives can be calculated using hyper-dual numbers: http://adl.stanford.edu/hyperdual/