Refactoring used to have a very real cost - it was substantial amounts of time that would have to be carved away from working on new features.
Now I can spot a potential refactor, fire off a prompt in an asynchronous coding agent (or on a worktree or whatever), then come back 20 minutes later and either accept it, poke it a bit, or abandon it. Costs me almost nothing.