Surely lowering the price of precious material will make everyone better off, they'll just stay the same relative to each other?
They won't stay the same relative to each other if anyone's current wealth is more related to the scarcity of the precious material in question than anyone else, which is guaranteed to be the case for any precious material.
But the dynamics are the same so long as the supply glut is in things interchangeable with what is precious (e.g., diamonds that, down to the De Beers microetching, are indistinguishable from the ones that people place value on.)