alternatively subset of the numerical analysi wikipedia page or these algorithms in the book is a good seed filter [2]
ideally covers some linalg like gaussian elim, power method, newton's root finding dynamic, and issues like approximating by discretization, recursion to reduce solve iterations, and things like convergence due to numerical instability due to IEEE 754 fp16 limits etc
1. https://en.wikipedia.org/wiki/Numerical_analysis
2. https://chatgpt.com/share/67002e8c-c5c4-8008-83f9-a6ebc603ad...
Faster Math Functions:
https://basesandframes.files.wordpress.com/2016/05/fast-math...
https://basesandframes.files.wordpress.com/2016/05/fast-math...
Even faster math functions GDC 2020:
https://gdcvault.com/play/1026734/Math-in-Game-Development-S...