The core problem, I believe, is that federal debt is like a blank check that nobody is personally accountable to repay. The result is that people in charge of spending simply do not bargain well. There is no immediate incentive to drive cost down by forcing suppliers to deliver at a lower cost, or find the the real market equilibrium where nobody will offer a service.
Loose spending from the government is a different problem than government spending in general. If the government were interested in getting the best deal, it has more bargaining power than most entities in the world. However, they frequently pay MORE for the same services. That alone should be a trigger. I think most people intuitively know this and rail against it when confronted by examples like student loans being spent on predatory for-profit colleges, but, in aggregate, I blame most of the problem here.
The government has a nearly infinite potential for more debt, and as a result they have no incentive to get a good price. Things have spiraled out of control.