The highest GDP growth was in 1942, due to war production. But it required going into massive debt, and massive mobilization of adults into the factories, so I don't think that counts.
GDP growth in the 1800s is a rather dodgy time of statistics, as economic statistics were not collected then.
From 1800 to the Civil War, the US economy began to be industrialized. The Northern states industrialized, while the Southern economy stagnated.
The 1870s and 1880s are considered a very prosperous time. It was a time when industry really got in gear and was applied broadly.
I don't have hard facts, but prosperity in my life seems to have been driven by the computer industry, a pretty much completely unregulated sector of the economy.