Did they actually replace the HMM with a neural network? I'm only going by the abstract, but it seems that they just replaced the usual Gaussian mixture models with their neural networks.
The link in the article didn't work for me; I'm referring to: https://research.microsoft.com/apps/pubs/default.aspx?id=153...