“You need to spend 20% of your sprint refactoring.”

Yes! Agility is largely a function of (the quality of) your code assets, so much more so than your team processes. And you can’t keep a code asset at quality unless through constant vigilance (ie, refactoring).

Now we only need to talk about who is doing the refactoring and what are their values?