I think LSTMs are far from being replaced. They work too well and are too simple to use.