If everything wasn't so built around CUDA the M1 GPU actually gives you twice the performance
Source?
Look at any online benchmark? It runs at a similar clock and has twice the tensor cores, the AGX is a 2 year old 12nm chip. Why would anyone be surprised if the M1 was faster?