I built a few generative Twitter bots with character level language models[1] (@steam_gaems for instance) and one problem is that they spit out phrases from the source text relatively frequently. So I included a function to re-generate the output if it matched any input phrases. Brute-force but effective.
[1] http://karpathy.github.io/2015/05/21/rnn-effectiveness/