I think Theano takes the crown as first modern end-user library for autodiff and tensor operations.