> It is very important to us that the deployment of fine-tuning is safe. To preserve the default model's safety features through the fine-tuning process, fine-tuning training data is passed through our Moderation API and a GPT-4 powered moderation system to detect unsafe training data that conflict with our safety standards.

I wish there was some documentation on what kinds of things are determined unsafe. There are plenty of things I think we would all agree are unsafe. I'm sure we don't want fine tuned models on how to cause physical harm on other people.

I don't envy the challenge of making the call for more gray area, sometimes even cultural differences, in what is safe or not. Seems like a very hard problem we've seen social media struggle with. I'm reminded of some of the Covid "misinformation" being deemed as unsafe