> The thing that people strangely still seem to not get is that these systems will continue to improve rapidly

Where is the plateau though? What we have so far is definitely impressive and useful in some cases, but I can't help but eye-roll every time I hear someone seriously talk about making nuclear reactors JUST to power the millions of GPUs needed to train these models.