So, is deep learning eating HPC's lunch?

And if it is, how much of this involves deep learning buying computer at a cheaper rate than HPC?

Most serious HPC involves simulating something (weather, atomic particles, car crashes). Lately, there has been a lot of work using neural networks to approximate such simulations more effectively. But would these make sense if the HPC program ran on GPUs to start with.