Relativity fixes that a little, you don't need to go light speed to make it all over the place within your lifetime, it's the observers who sent you off that will never reap the fruits of their effort.