The equations you quoted result from minimizing the square of the norm of the residual of Ax-b over all inputs x, so in a sense least squares is just calculus…