Very good write up how performance can be improved without the typical rewrite in X.
Your general comment is correct. I see it often with GPU algorithms which, no surprise, are also much faster on CPUs (using something like ISPC to compile them).
An approach that tends to be ignored by those rewrite X in Y.