I'm not sure I follow. C++ just added a SIMD library for this exact problem. And even then, SIMD-intrinsic-free C++ with the right data structures and some basic hardware understanding gets you mostly there in a hardware agnostic portable way.
That's what I mean about "discoverability crisis." This post is how I learned about the existence of the SIMD library.