They just announced their new chip, and they are the ones created transformers yet investing this amount in a competitor?
I don’t know what to make of it
I don’t know what to make of it
"Attention Is All You Need" was a very very different thing and I also wonder if they are glad they published it. But I imagine if they hadn't, the motivation for researchers to leave Google would have been even larger.
Jeff Dean is asked this question by Geoffrey Hinton at 37:35 - might worth watching. Overall an interesting video.