GPU is actually relatively easier to scale by adding more cores/ALUs. The difficulty lies in figuring out how to handle peak current requirement of the whole IP.