Yes, almost certainly the next phase for performance-intensive computing is more specialized chips, systems-on-a-chip, and whole specialized rigs. The TensorFlow Processing Unit is a good recent example of this, as are ASICs in bitcoin mining, specialized hardware in molecular biology simulation, and more examples. This is just the beginning.

I think the interesting question is what happens after that. Not too long from now, specialized systems will run up against the same physical limits that general purpose processors have begun to hit the past few years as well, as specialized fabs increase in capability and sophistication. We see this already with GPUs.