Even on the train from Narita Airport to Tokyo, you'll pass plenty of comparatively run down "commerce areas" adjacent to small train stops. The buildings are old, and made of nondescript concrete that have been stained by the rainfall over decades. It makes me uneasy every time I see these sort of buildings.
Taking the Narita Express or the Limousime Busses will largely insulate you from seeing those things though.