I wouldn't say arm is screwing around, apple silicon is no joke. The thing is that the M1/M2/etc. cpus are incredibly good partly because of their raw cpu performance, but also because of the big/little design and the extra niceties (amx, etc.)
If you're going to add your own instructions anyways, then why go risc-v over arm?