The US economy also had no problem growing fast during the 1990s, when the US Dollar was strong and had appreciated extremely strongly against gold over a 20 year period ($600 in 1980, to $270 in 2001).
China also dramatically counters this notion. The Yuan has appreciated significantly (for a currency) over the last decade, while they've simultaneously gotten far wealthier.
The disaster has been what has happened to our money since 1971 (specifically the 1970s and since 2001). The real cost of goods has gone parabolic.
1964, 5 silver quarters (90% silver, 10% copper) for a $1.25 minimum wage, now worth $25.90 ($5.18 each). That's pure destruction via inflation.
And that's not even getting into how the Fed + Congress funds insanity like endless war because there is no gold standard restricting their spending habits.