The Math Under Every AI Model: James Wilkinson and Backward Error
nirmalutwani.substack.com
nirmalutwani.substack.com
Forward errors are hard to compute in general because you need the right answer and then do the subtraction, but backward errors are much easier to compute. It’s how much you have to nudge the inputs to make your answer exactly right.
Code, a runnable demo, and the full writeup: https://github.com/nirmal91/turing-award-series