Hi, paper author here. The model was fine-tuned on (non-Reddit) data that was specifically designed to give it positive conversational skills, like empathy, knowledge, and personality (see: https://arxiv.org/abs/2004.13637).
No FB data was used to train these models, which is what allowed us to open source it.