The gov't can take your physical gold just as easily as they can take the computer with your wallet. Nothing is yours if the state says it's not.