Yes, but the Fed enables this behavior by loaning the banks money.

The point is, it's due to the govt that the money supply is increasing hence we have inflation.