That's not because of the processor. It's because the newest iPad Pro has a 120hz display and the other devices that you were comparing to have a 60hz display.
The M1 processor makes a real difference. I have both the M1 and the most recent non-M1 iPad Pro's.