But there's a real risk that in the long term all of the "serious" AI hardware research will get done inside a few big companies, essentially shutting out smaller players with a hardware moat.

Unless they start selling the hardware, but in the current AI market nobody would do that because it's their special sauce.

On the other hand, maybe it's no different than any other hardware, and other makers will catch up eventually.