Very anectdotal, but the three Japanese persons I know have told me that people in Japan are generally negative towards holding an Olympics and think it's just a waste of resources.
The people who were the most outspoken in Whistler against the Olympics became some of the biggest cheerleaders when the event came to town. When you're in the thick of it, it's difficult to not be amazed at how great the Olympics is.
Yes, every host country ends up losing money. Let's not forget, Japan just held the Olympics in '98, and had previously done so in '64, so they know what they are getting themselves into.
The Olympics really are a terrible waste of effort and resources for the host nation, and the host nation rarely, if ever, gets a positive return on it. Mostly, it seems only to serve to increase the prestige of some head-of-state, nothing more. In reality, it costs an enormous amount of money to build facilities that are only used once and then go to waste. The world would be better off designating two separate, permanent Olympics facilities, one for summer and one for winter, and just reusing those every 4 years.
[1] https://en.wikipedia.org/wiki/Calgary_bid_for_the_2026_Winte... [2] https://en.wikipedia.org/wiki/1988_Winter_Olympics#Impact_on...
If we held it in Athens (not sure if Olympia could support it?) for the summer, then have it rotate between countries that can host without massive infrastructure changes for the winter (NA - Calgary/Lake Placid, Europe - St. Moritz, Oslo Asia - Beijing, Pyeongchang).