How long would take them to get a new chip into production and then used for training/inference?
You can throw more money at it to make it go faster, but it also might fuck it up and take longer.
Which is the story of AMD for the last ~15 years.
getting support so we could develop apps for their graphics card was dispiriting. at the time they were faster and very much cheaper than nvidia (but no cuda) But every time we found an issue, the poor devs who were contracted to fix it were left struggling.
Its the same where I am now. We were trying to qualify some motherboard/TPM/other issue, but they didn't have enough bandwidth to help us in time.
Its better now, we do have some AMD stuff in the fleet.
At least from someone who is on the edge of the business and seeing what is going on. It is a lot better now, especially at the enterprise level. They've been hiring and buying companies too.
It won't be fixed over night, but it is definitely a renewed focus.
Once they get it right, they will increase the gap with other LLM providers.
Apple didn't build their M1 chip from scratch. By the time the M1 chip was released they had already been building chips for the iPhone and iPad for several years!