Ask HN: Will something replace transformers and GPUs in the next 10 years?

I don't know why but I have the feeling that a huge amount of money (NVIDIA worth trillions, billions dumped into LLM-based companies) is supported by a single idea that might eventually be replaced by a completely different paradigm or by a new approach to LLMs that could make all of this worth nothing in a matter of months.

To be clear, I’m not saying this isn’t a super impactful idea and I actually think it's a revolution. Since Attention Is All You Need came out in 2017, everything has changed fast but it’s just that I also feel that another breakthrough from research could appear in a similar way.