They also own a high end networking company and will sell you an entire rack or datacenter integrated for you. Also yeah, the decade or so they’re had thousands of in-house engineers and people around the world working on CUDA is HUGE. Also the crypto boom encouraged them to buy up tons of fab capacity. Nvidia had foresight on multiple levels here.
Nvidia’s problem is that every company is a credible threat because in the ongoing gold rush they can’t make enough shovels to meet demand and damn there is gold in them thar hills. People are going to do literally whatever it takes to make their competition’s products work. If you are selling a shovel, even a shitty shovel, you are a competitive threat to Nvidia right now.