Hacker News Reader

They do train SOTA models, for sure, but do either of them produce accelerators or ML frameworks?

Microsoft and OpenAI have different technologies they have worked on including ONNX + ONNX-RT and OpenAI is focused on Triton which is a kernel compiler being used to speed up models. Given my understanding of heavy PyTorch use it seems more likely they are utilizing that + triton versus XLA.

Microsoft has DirectML for hardware acceleration on Windows, but maybe you can run OpenXLA on Windows anyway if the GPU drivers support it? It would be preferable if they were on board, I don't want to be dependent on Nvidia or AMD.

What hardware do they produce which would need to support it?

The fact that Intel AMD and Nvidia plus three cloud are on board suggests MS might get left behind

Definitely feels like critical mass

It isn't as if C++AMP, DirectML and .NET ML have had much adoption.

While ONNX Runtime seems to split efforts away from .NET ML.

It is an area where they seem to suffer from the same management issues like in desktop GUI frameworks of lately.