HNHacker News
TopNewBestAskShowJobs

bshark

4 karma · joined March 29, 2025

submissionscomments
bshark··on Every Flop Counts: Scaling a 300B LLM Without Premium GPUs
The 96GB (HBM2e) SKU is named PPU from T-head semiconductor (basically a subsidiary of Alibaba). The spec is very similar to H20. Other chips they were using include Huawei Ascend 910B (64GB) and maybe other domestic designed chips.