Looking at the S&P chart since the 1920's there have been several decade periods where he would have lost the bet. The increase in the past 20 years has coincided with ever lower interest rates - which may have ended.
https://www.macrotrends.net/2324/sp-500-historical-chart-dat...