How did you make the move? Are you Japanese or Asian? I would love to move to Tokyo or similar but feel I would be discriminated against for being a dark skinned Indian male.
I don't know what your profession or situation is, but if you can line up a job you can pretty easily get a work visa (it's much less binding than US work visas). Japanese corporations are known to have pretty brutal work culture so that's something you ought to be aware of when searching, if you seriously pursue it. Hope it's interesting food for thought :)
I have no doubt there are racists here, especially in the rural areas. But I also have no doubt that the same holds true for places like California and Washington. You may be keeping yourself from experiencing areas of the country that you may love and would love you back.