Hacker News Reader

I believe besides the legacy Nvidia cards, Alibaba has built training clusters from domestic AI accelerator vendor like https://e.huawei.com/en/products/computing/ascend.

But that means a lot of extra in-house engineering work to utilize those niche hardware.

They probably buy them through intermediaries.

They can train it in a data center in Singapore or Taiwan!!

why is this being downvoted? isn't this what is actually happening?

A100s, (old) A800s, H100s or (old) H800s.

How did they get them? Who knows, but it's there.

The restrictions are fairly recent. Unless a Stuxnet disables all GPUs in the country, there is probably a lot of existing infrastructure.

Baidu specifically claims they have orchestration technology to train on heterogeneous gpu clusters.

Could you share the source on that?

keyword: Ascend 910B