Stumbled upon this paper. '...automatic symbolic differentiation framework and the gradient descent
operator together with the proposed tensor algebra to be integrated into database systems'. This seems quite a bit more advanced than say BigQuery ML in its current form, which as I understand supports batch gradient descent for some pre-specified models. Any thoughts? Should we expect automatic symbolic differentiation support in future database offerings?