The kind of xenophobia you'll be facing is pretty tame compared to most other parts of the world though. Especially if you're a skilled worker from a developed country.
Japanese are indifferent and non-confrontational. If you don't care about what people think and don't try to integrate too hard, life isn't bad.