Sorry, I was under the impression that he's talking about the Michelin rating people showing up and telling them how good or bad his food is rather than simply visiting and writing a guide which contains his restaurant. I can understand the pressure of being on the list and maintaining one's position, but there's no reason why he couldn't let that slip; being lower on the list is better than not being on the list at all in terms of prestige, so he obviously doesn't care much what a "foreign" guide writes about him.
The idea that only Japanese people can judge Japanese food seems to me very xenophobic; if that wasn't his intention then he should have spoken in general rather than targeting "foreigners".