Hacker News Reader

350x is only about 10-20 years of improvement, using CPU FLOPS as the benchmark.

Haven't CPUs largely plateaued? They're just getting bigger, more power hungry, and multiplying cores.

Physics has hard limits and Moore's law is long dead.

AFAIK these don't have to be CPUs. ASICS are well suited for this purpose. This will be the most cost effective way to run LLMs.

wouldnt you want gpu, fpga, or dsp as the benchmark?

its lots of parallel calculations, rather than one blazing fast one