even in Shinjuku there are cheap houses if you look. My friend rents an old house with renovated interior in Shimoochiai for what I thought was surprisingly cheap