Attention was invented because Bengio lab had to be disciplined about a black box (google had more compute)