LSTMs were around for about 17 years before they revolutionised NLP.