Exactly. More like changing the state of the system to reduce the observed behaviour while introducing other (unknown) behaviours

I don't think that's quite true; even a system you don't understand has observable behaviour. And you can roll back to a certain state that doesn't exhibit the undesirable observable behaviour. If anything, most things in life operate this way.