Hacker News Reader

It's not like same parameter count models are identical, so that doesn't appear to be an indicator for quality, or even compute requirements?

There seems to be more to producing a better model than brute forcing parameter count after all.

View on HN

Training and serving large models does require increasingly more compute, though. (The Chinese labs have clearly found some massive optimizations, but my point was that you'd think at some point even those optimizations wouldn't be enough to keep up with exponentially increasing model sizes.)

Reply on news.ycombinator.com