Goverment budgets are highly unelastic - railways, submarines, healthcare, pensions must be paid. So even small increase in costs of servicing debt results in embarasing and painfull cuts in elastic areas of the budget.

So in general MoFs avoid that unless they are going to pass the ball to the opposition.

But of course you have to borrow to roll old debt.