Hahha, good one. Just that by the time that one dev implements everything, you'll be overtaken by the competition -- at least that's what everyone's fear is, and it's partly warranted.

Many problems are bandwidth-limited. More cores may indeed actually hurt performance as contention for the limiting resource makes it increasingly hard for any core to run efficiently.

https://superuser.com/questions/2489/cpu-cores-the-more-the-...

You can't spend your way out of the latency issues associated with such a distributed architecture, though.

That's one of things NVLink helps with, actually.