Yes, these models can applied to a lot of non-NLP tasks. For example, I've seen seq2seq models applied to medical record prediction, program generation, etc. Noise removal seems like a good candidate.