> But 65,536 cores with 1KB of memory each doesn't sound very useful either.
You've just described the general architecture of the Connection Machine[0], a late 80's early 90's era supercomputer that was used for modeling weather, stocks, and other items. It was fairly useful in it's time.