As long as you were a straight white Christian male, maybe.
I'm not buying it. Turn off the news and go out into society, preferably one of those small so-called racist communities. You'll find out the truth, one way or the other.
Others came to work the railroads because they were willing to trade racist abuse for economic benefits.
Are you really that unfamiliar with American history?