My hunch is that there is some fundamental misunderstanding of what CUDA is and why it works. Its been like 6 years now of well funded attempts to displace CUDA, and there has been very little progress. In fact I'd argue its gone backwards as things like FlashAttention have further locked in the benefits of CUDA & Nvidia chips.