Here we are having philosophical debates about it, but I suspect if we just stuck with the math -- regardless of our intuitions -- most of these kinds of arguments would turn out to be a distraction rather than a solution to the problem. That's kind of the point many empiricists like Krauss are trying to make.
I believe that it is not possible for an infinite amount of time to have elapsed before this moment in time. I think that is what the quote in question is attempting to state.
Scientists "freeze" light inside a crystal for one minute. [0]
Stopping single photons in one-dimensional circuit quantum electrodynamics systems [1]
[0] http://www.gizmag.com/stopping-light-inside-crystal/28610/
[1] http://www.ese.wustl.edu/~jushen/Papers/Stopping_Single_Phot...
In those experiments, "stop" usually means absorbed and later re-emitted.