Hacker News Reader

I currently publish a series of detailed articles that cover exactly that.

https://dragan.rocks/articles/19/Deep-Learning-in-Clojure-Fr...

dragon.rocks, rocks. Your articles are some of the best i have seen on this topic. Thank you. I hope you write a book on this topic.

Thanks! We'll see. BTW, its dragAn, not dragOn :)

Agreed, it is a little confusing. What makes it even more confusing is bias can be introduced as a regularization technique (to address overfitting) and these are not the same thing.

Bias in this context can be simply interpreted as analogous to the intercept in y = mx + b. Kind of like the baseline when no additional information is given.

Partial derivatives are basically how much a multivariate function changes based on a tiny change in a single variable. The actual math is irrelevant.