This, and plus the fact that in almost every country on Earth now, buying Gold needs an ID of some sort so that governments know exactly where to look for Gold the day they want to seize it. I think one of the last places where you can buy Gold anonymously is Switzerland.
EDIT: and you have to trust that the Gold you buy is real. There's always the risk it's gold plated tungsten or something.