There are lots of different moments & quantiles of the income distribution that are interesting and useful to look at, but its not like the mean is terribly misleading here. In the plot you provide, median income in real dollars has increased from 25K in 1950 to 40K in 1990---a 70% increase in real income.