136 karma · joined February 26, 2018
While achieving an open-core design comparable to Zen 5 is unlikely in the near term, a sustained open-source collaborative effort could, in the long run, significantly change the situation. For example, current versions of XiangShan are targeting ~20 SPECint 2006/GHz (early where at ~9).
I suspect that many projects—such as BOOM—have stalled as a consequence of this situation. If it continues, the long-term impact will be highly detrimental for everyone involved, including stakeholders in Western countries.
The unfortunate reality is that no one truly understands how memory works. Many theories are floating around, but the fundamental components remain elusive. One thing is certain: it is quite different from backpropagation. Thankfully, our brains do not suffer from catastrophic forgetting.
It may not magically appear. It may, by design, be woven into the learning process.
-- 1895, Lord Kelvin, president of the Royal Society
https://www.searchenginejournal.com/openai-pauses-new-chatgp...
The back-end cost does not scale. Hence, they have a big problem. AGI nonsense reasons are ridiculous. Transformers are a road to nowhere and they knew it.
I guess intel SGX chaos didn't help either.
Note that while the performance effect of L1I cache misses is negligible, the complex x86-64 decoder may not be. Some SPECpu2017 have front-end problems due to the x86-64 decoder.