If I may, I had also built a simple demo of linear regression using gradient descent before writing this post. https://raiboso.me/backpropagation-demo/

This demo allows you to choose between four optimisers, and lets you track the values of your variables during training.

Compare your runs with different optimisers using the graph at the bottom of the page.