Sure, but transforming a feed-forward neural net into an RNN is also not just a fine-tuning.