It was really amazing to see how little smoking is visible in Tokyo and Osaka these days, even taking vaping into account. I don't know what the smoking/vaping rates are, but it's increasingly confined to homes or small smoking areas which makes things much nicer if you're a non-smoker.
The fine is small, but I think in Japan the shame is probably the real punishment - 1000 yen might buy you two beers in a bar.