Yes, the problem is that fixing stuff can (and does) create regressions.

So what REALLY HELPS is -- Fix ONE thing at a time.

Usually, when I'm writing code or fixing something, I put in a couple of unrelated improvements. There's a pretty good chance the unrelated improvements will break something.

Breaking the unrelated improvements into their own separate self-contained step is usually all it takes.