Here is an example on how to do this using github.com/google/highway:
https://gcc.godbolt.org/z/zP7MYe9Yf
You write the code only once and do not have to worry about any #pragma/conditional compilation. Just copy-paste about a dozen lines of boilerplate, link with the Highway library, and done.
Disclosure: I am the main author; happy to discuss.