Supply is only one half of value. The demand for gold is almost entirely speculative, whereas dollars can be directly used for almost anything.
[1] -(Let's exclude intentional market manipulations like if a world leader were to buy a bunch of gold and then saber rattle to drive up fear).