You might be right, but none of that speaks against the urgency of doing it, or explains why people don't see it.
Even more urgent than colonization is the achievement of immortality, but I don't see people urging to achieve it for the same reason, i.e they think it's not practically achievable.