Something like that, but with more cores and cheaper.
It looks like there are up to 64 cores in Xeon Phi at 1.5Ghz (price > $1000). A Nvidia 1030 is still better with more than 300 cuda cores at 1.4GHz (price ~= $150). Not that I think that cuda cores and Xeon Phi cores can be compared, but 64 is not that much at that price... What we'd need is dumber cores in very high number. We don't need all fancy things that normal CPU cores have, like virtualization.