The reason they sometimes win is huge structural or incentive issues in the large companies. And they don't win often.
AMD has failed to fix the problem for years. Is it because the business structure doesn't incentivize it? Is it because the company's entrenched culture is opposed to compensation that might attract the right talent (often out of "fairness")? Is it because there's some internal owner for the function that keeps fucking up but for political reasons the CEO won't replace them and no one else can work on the thing?
Any of these are possible. I have seen - personally witnessed - all of these and more at large companies. We don't know the reason, but we can sort of guess as to the shape of it.
It’s really as simple as that and it still hasn’t changed so nvidia is dominating them in AI as a result.
They should've been adding tensor cores and neural acceleration to their CPUs. The need for headed graphics cards is moot and wasteful. NVIDIA solved this with the A100.
NVIDIA may spin into a mainstream enterprise CPU and systems vendor as a sales channel for converged CPU-GPU solutions beyond what they're already doing.
Of course nothing is perfect and you can never have 100% trust to someone else hardware, but it's defenetely step in right direction.
That being said I am still sceptical.