Protip to people down voting: This wasnt a joke, chaining rnn behind cnn is precisely how you give neural networks context and short term memory.