The invention of the transformer architecture that underpins modern AI, dozens of core papers in the field.
What they haven't revolutionized is materials science. Memristor technology for example, is still grossly underdeveloped.
The invention of the transformer architecture that underpins modern AI, dozens of core papers in the field.
What they haven't revolutionized is materials science. Memristor technology for example, is still grossly underdeveloped.
Less and even less.
yes it was just a joke, wordplay, really.
I barely used windows for workgroups. but I did use windows from XP or 95 onwards. actually I used both. and yeah I remember a bit about the hardware discovery. it was called plug and play, iirc.
I remember reading how badly windows Vista turned out.
and then there was 8, which I didn't check out much, but remember reading it was somewhat of a flop, because they tried to make everything mobile oriented, even on desktops.
haven't used windows much since, except for 7, which was okay for me.
Go look at the breakdown of the number of research papers coming out of Google. In 2023 there were 744, in 2017 there were 637. Two decades ago, there were half as many.
mumble business cycles
mumble corporate cycles
mumble evolution
"When we set up DeepMind, I took inspiration for our research culture from many innovative organizations, including Bell Labs and the Apollo program, but also creative cultures like Pixar."
https://www.theatlantic.com/sponsored/google-2023/unlocking-...
As for materials science, there's signs of life in graph nets https://deepmind.google/discover/blog/millions-of-new-materi.... Meanwhile maybe AlphaFold indicates a precedent towards deep learning systems that advance chemistry. I don't claim these are revolutions, but extrapolating into the future, they might be seen as the catalysts. Maybe.
The whole point of memristors is to make something better than DRAM and SRAM. Perhaps even blow up the dichotomy between storage and memory altogether (as memristor MRAM can store information even when powered down, unlike DRAM and SRAM). Let here we are in 2024 with no viable memristor products on the market.
Oh man, coming neuroscience I had no idea why these weren't being more researched. Thanks for the info there.
Just as an FYI to y'all, a memristor is essentially how a synapse works. In that it's an electrical element that counts the change in charges across the leads over time (dCharge/dFlux or dq/dPhi). And all for very little power and it survives power cycles.
Like, we talk about AI these days, but memristor incorporating hardware would really get us there. You'd just, you know, need to invent the solid state memristor first, and then make it commercially viable, and then redesign all of computer architecture from the transistor on up. Easy-peasy.
But any research of incremental improvements in an attempt to make the tech commercially viable is stymied.
And I would love to see some accessible and available non-volatile RAM measured in gigabytes. It means computers that never get switched "of, no more than a paper book can be switched off. It would take a radically different approach to operating syssystems to reap the benefits though.