Hacker News Reader

Comment by vinay_ys | Hacker News Reader

If you mean US by 'we', it is problematic because AI inventions are happening all over the globe, much more outside US than inside.

View on HN

Name one significant progress in the field of LLMs that happened outside the US. Basically all the scientific papers came from Stanford, CMU, and other US universities. And the major players in the field are all American companies (OpenAI + Microsoft, Google, AnthropicAI, etc.)

Not to mention access to chips. That's becoming more and more difficult for uncooperative states like China and Russia.

Well, chips needed for AI training/inference are lot more simpler than general purpose CPUs. Fabs have already demonstrated 7nm process with older DUV tech for such chips. They can brute force their way through it – at least for mission-critical use-cases.

https://www.edn.com/the-truth-about-smics-7-nm-chip-fabricat...

Deepmind is owned by Google, but it's British and they've been behind a lot of significant conceptual results in the last couple years. Most significant progress is just "engineering", so it's all done by US corporations.

Other than that there's also things like roformer, but I'm going to assume you won't count that as significant. US universities then certainly don't produce anything significant either though.

> “just engineering”

This tells me the extent of your knowledge about the challenges with these models.

Reply on news.ycombinator.com