In theory, if the government spends by borrowing there should be less of an inflationary impact since the money is taken from the private sector and recirculated.
In practice, the bonds and bills are used as collateral for new private sector loans, so the inflationary aspect is almost entirely preserved.