50,000 years ago (or so) we were a tiny species hanging out in Africa. We didn't think in terms of years, much less decades. This was before we figured out how to measure the length of the year or to predict when the winter would end.
And yet, without any central planning or coordination, we left Africa and colonized Europe, then we headed out across Asia and crossed into the Americas. Plus we sailed from Asia and colonized Polynesia.
Imagine someone saying, "We're doomed because people walk very slowly--it's going to take a thousand years to get to the southern tip of the Americas." And yet, we did.
I think the same thing will happen with space travel and ultimately the colonization of the galaxy.