For inference there are many solutions like groq. The margins there will be small.
The fat margins is in training, in NVidia hardware.
The fat margins is in training, in NVidia hardware.
That said, I'd much rather be leading in training than inference, of course. Nvidia still leads in inference, by the way.