Its worth nothing that you could end up with an ever widening gap, but you could also end up with an ever growing surplus if your early years get > 4% return.
I don't think any calculators really deal with this other than http://www.firecalc.com/ (which has a terrible ui -- look for the big red 'Start Here' text and then click the 'Submit' button). Building a user friendly firecalc clone has been on my todo list for while. I'm not sure where they got their data.
With regards to my other calculators on Networthify, I'm not sure how to create a usable ui that reflects this reality.
Also there are at least 2 other big unknowns -- taxes and inflation. So when I'm calculating how much money future-you will have I'm not too worried about ROI. I agree that people need to understand these calculators are just educated guesses. Still -- you do the best you can with the information available. Its better than closing your eyes and not even examining the possibilities. At least you can calculate some worst case and best case scenarios.
-- UPDATE
Oh hey, do you mean there is some sort of formula for expected annualized return?