M1 Pro CPU is faster than the GPU for anything less than 512x512

the CPU backend uses that. this is why the number is so high compared to more conventional CPU/GPU trade-offs