You think Nvidia's advantage on LLM is hardware? It's the software ecosystem around the GPU (that Nvidia took a decade+ to build) that is the advantage.

Are they competitive per Watt and per mm2 of die?

And software