We're way into diminishing returns in matrix multiplication, and being clever about ALUs and cache layout is likely to dwarf any asymptotic improvements you're going to find. Any better examples of improvements in the last decade?

The main situation I can think of where better calculations have a really visible effect is video and image compression, and that stuff is very far away from mathematical proof territory.