235 karma · joined October 9, 2018
Batch-1 token generation, that is often quoted, does not benefit from this. It's purely RAM bandwidth-limited.
The history of the PC is one of commoditization. A fractured multi-polar landscape is detrimental to the ecosystem/productivity and should ultimately fail.
x86 emulation is an important puzzle piece, and I'm happy Valve recognizes this and sponsors it.
Because 17B active parameters should reach enough performance on 256bit LPDDR5x.
This project works around a limitation in MacOS, namely lack of thread pinning, and makes it possible to do it without Asahi Linux, and without using custom MacOS kernel extensions and disabling security features.
Having inflation above the interest rate helps decreasing the debt/gdp ratio.
Might even forebode soldering RAM onto packages from here on out and forever.
Steamdeck will probably have a crazy 100gb/sec ram b/w. twice of current laptops and desktops.
Laptop/desktop have 2 channels. High-end desktop can have 4 channels. Servers have 8 channels.
How does Apple do that? I was always assuming that having that many channels is prohibitive in terms of either power consumption and/or chip size. But I guess I was wrong.
It can't be GDDR because chips with the required density don't exist, right?
- obscure software and programming paradigms/libraries
- one-off's
- projects that create only reports, papers and recommendations
- endless recreations of the same software over the years and decades
- plain dumb projects
- attempts at recreating other people's software (e.g. U.S.)
There is also a large amount of overlap in work/content between projects, and lots of time is appropriated for unrelated work e.g. employees working on their PhDs.
On the other hand the industry takes a lot more money and plays similar games.
Project partners do not take the right path, because it's not conducive to fulfilling a grant, getting the next grant or increasing your citation count. The incentives are wrong.
Not sure you would include foreign companies with plants in the EU. Nexperia, TI, GloFo.
https://en.wikipedia.org/wiki/List_of_semiconductor_fabricat...
Aside from that I'd expected chip designers like ARM (+licensees), Bull Atos (would you call that an OEM?) and related software companies to take part in this.