It's just reversion to the mean. M1 had a beefy CPU and lightweight GPU. M1 Pro/Max is a beefy CPU and a beefy GPU.
There's a substantial subset of high-performance computing tasks that are limited by GPU performance. But that's far from the whole equation.