Microsoft, Google, Amazon, Meta are all building or using their in-house chips already and are working hard to replace Nvidia as much as they can, especially on the inferential side. OpenAI is basically doing similar things, nothing magic other than Altman wants to use his own chip design.

Further, on the hardware side, you have Nvidia, AMD, Intel that are competing fiercely.

OpenAI is already under attack from Meta and Google and who know how many LLM companies, while it's the first runner for now, that might change fast.

In the worst scenario, its LLM will become just one of a few in 2024, and its chip design will be a few years away if anything and might just turns out to be nothing, just look at Musk's Dojo AI chip, which started years ago and still he is buying Nvidia.

Keep acing at your LLM, and leverage Azure's platform for now, then also use some AWS to be safer. Forget about making your chip, it's too far away, and it's too crowded there and too late, you don't need to do everything to be successful, at least, no rush for that now.