"Attention is all you need" was a silly name and most people who name their stuff are poking fun at it. Obviously, attention is not all you need. Just like lucene isn't all you need.