So when people told the staff the models were racist you think they just "asked it to be less racist" I think they did a little more than just adjust the input data, they also modulated the logic behind the Weighting methods. No?
No. They did not change the logic. They cannot change the logic. They wouldn't have a clue how to do that. No one does. The neural network is practically impossible for us to understand and manipulate directly at that level. Way too complicated. They trained it to be "less racist" by RLHF until it was sufficiently woke.
The logic is exactly what is "learned" automatically by the machine and is beyond our current abilities to understand at a low level. The neural net is too vast.
> you think they just "asked it to be less racist"
Yes that's basically what they did. It is incredible technology.
Maybe we need a similar discipline to understand models and how each neuron impacts the overall behavior of the model. Neuronics?
Or better they shift the distribution by finetuning the model on curated data.
But no, no one change the parameters manually, it's just too complex, an artificial brain.