that's surprising to me. Torch supports ROCm, why are startups wasting their money on H100s if they can get a better deal with AMD GPUs?

It’s actually better than the H100 by a mile in some inference workloads, but in others falls behind.