Some state-of-the-art industrial speech recognition [0] is transitioning from HMM-DNN systems to "CTC" (connectionist temporal classification), i.e., basically LSTMs. Kaldi is working on "nnet3" which moves to CTC, as well.
Speech was one of the places where HMMs were _huge_, so that's kind of a big deal.
[0] http://googleresearch.blogspot.com/2015/09/google-voice-sear...