You know what else is an obstacle to relativistic spaceflight? Being able to do relativistic space flight.

Fun fact: people realized this a long time ago, and proposed different "shields" in front of the ship (it turns out that the most effective shape is a smoothed-out cone [of ice, say] -- see Asimov's Song of a Distant Earth).