https://en.wikipedia.org/wiki/Ablation_(artificial_intellige...
Have you read some (any) actual papers from the word this all and LLMs are?
Well here some:
https://arxiv.org/abs/1901.08644
Tis ablation ablation and ablation everywhere save for some kid’s fav. model names and their X pals.
> The term abliteration has been coined for the process of using ablation to uncensor large language models by modifying internal functions to completely eliminate refusal behaviors while preserving the remaining functions of the model. The word is a portmanteau that combines the words ablation and obliteration.
So are you dropping this now?
Note that they're all talking about the same technique, namely applying ablation specifically to the refusal vector as described in https://arxiv.org/abs/2406.11717.
I really recommend letting this one go.