1,829 karma · joined March 9, 2010
#1, a single neuron: https://www.splinter.com.au/2024/03/10/neural-networks-1/
#2, one neuron's gradient: https://www.splinter.com.au/2024/03/20/neural-networks-2/
#3, training: https://www.splinter.com.au/2024/04/22/neural-networks-3/
#4, multiple layers and backpropagation: https://www.splinter.com.au/2024/07/10/neural-networks-4/
Thanks for your time, I hope it's somewhat informative :)
Complexity increases your surface area for bugs to hide in.
I've come to the conclusion it's tragedy-of-the-commons incentives: People get promotions for complex and clever work, so they do it, at the cost of a more-complex-thus-buggy solution.
And yes, it's not just software, it's everywhere. My modern BMW fell apart, in many many ways, at the 7 year mark, for one data point.