Hacker News Reader

The H100 theoretical flops number is just marketing, as it relies on sparsity that LLMs don’t use

And the practical flops always end up lower. As an example a V100 has 125 according to spec, but the ideal case is more like 100 and non-ideal like 60.

Reply on news.ycombinator.com