It's not a silly mistake. It was rlhf'd to do this intentionally.
When the results are more extremist than the unfiltered model, it's no longer a 'small mistake'
When the results are more extremist than the unfiltered model, it's no longer a 'small mistake'
I propose rill-hiff until someone who actually know what they’re doing shows up!