Well, when the authors write the following sentence, and in two tries, I get a racist result, yeah, maybe a little bit of shame should be involved.
We tried our best to avoid this issue by doing extensive dataset filtering. As a result, our benchmark indicates that Cedille is indeed less toxic than GPT-3.