Other than, you know, a company that calls themselves "Open"AI, who now even consider it too dangerous (due to competition), to even release the number of parameters of their most recent model, much less talk about the actual research.
Other than, you know, a company that calls themselves "Open"AI, who now even consider it too dangerous (due to competition), to even release the number of parameters of their most recent model, much less talk about the actual research.
Due to transformer deep neural networks mostly pushed forward to a 2017 paper called "Attention is all you need". Prompted by your question I searched where the people who wrote this paper work at, and... (unsurprisingly drum roll), a team from Google.
Do you think the general public gives Xerox PARC a lot of credit for modern computing? I don't think so, and it's fine. It will just be well known among technology enthusiasts and historians of technology.
I also think The Dream Machine should be required reading in a history class in all CS curriculum, but I'm not in academia.