Every financial debt has a corresponding financial asset. Why follow the 'debt' and not the 'asset'? Because you have a psychological anchor on the word 'debt' that causes an emotional reaction?
All money is somebody's debt. That's how the accounting works. Rather than looking at the books from the 'credit' side, why not look at it from the 'in credit' side?
What I find amusing is how the bank borrowing from you so you are 'in credit' with the bank is a good thing, but the government borrowing from you so you are 'in credit' with government is a bad thing.
Given those are identical propositions in accounting terms, rationally the view about them should be the same.