IME, Japanese elders are polite to a fault, so while I get pretty intimidated going to a new cafe (kissaten), I'm always treated very well. I once wandered into a yakitori joint and an english-speaking patron made my whole order for me when they realized I couldn't read the menu.

Golden Gai is another story, and I've heard about places in the deep countryside being a little more hostile, but those are exceptions.