You could periodically retrain the model using the original dataset plus the conversations from the period. Sort of a commit of the short term memory into long one.