I'm no philosopher nor a physicist either, but I don't see why that would even be a problem. We know by now that time is relative. To a photon, all of our infinite time, if it is infinite, "happens" all at once, so why would it matter if it took an infinite amount of it to get here. If you could stop a photon and ask it, it would reply that we were always here.
Here we are having philosophical debates about it, but I suspect if we just stuck with the math -- regardless of our intuitions -- most of these kinds of arguments would turn out to be a distraction rather than a solution to the problem. That's kind of the point many empiricists like Krauss are trying to make.