I don't understand the reason to want to "physically own" something, unless you think the banking/financial system is going to go under. If it does, inflation will be the last thing you'll have to worry about.
The whole banking system may not go under, but there's always a risk that an individual firm may go bust, like Lehman. If you happen to have financial assets held in custody by that firm, it might take a while to get them back.