Hacker News Reader

I would legitimately argue they are competitive. GPT-J and GPT-Neo are both fundamentally quite similar to modern LLMs, and when compared against other 4b and 8b parameter models I would genuinely champion the quality of their responses over their contemporaries.

View on HN

> when compared against other 4b and 8b parameter models I would genuinely champion the quality of their responses

You clearly have some very specific models in mind. Even if the latest 4B and 8B models don’t move the needle on the “results you would champion” metric, this does not advance your argument that the state of the art hasn’t significantly progressed from 5 years ago.

> I would legitimately argue

I’ll bet you would!

Reply on news.ycombinator.com