at this point it seems like the folks building supercomputers for DoE and the folks building TPUs for Google should be talking. Both sides have interesting technology, but the communities are too far apart. Modern ML training is basically very similar to supercomputing that I think by working together, DeepMind could make better use of an exascale supercomputer than most scientists running simulations. Some of the network innovations in TPUv4 could be used in supercomputers.