Massive overreaction in my opinion (not financial advice).
People are forgetting how much compute is being used for inference. This is going to be further accelerated:
- Reasoning models are going to generate orders of magnitude more tokens.
- Synthetic an augmented data is more and more prevalent, and if you need to process pre-training scale dataset, you will need a lot of inference.
- etc.