Similarly, in the 90s everyone thought Japan was going to eclipse the US economically, and (to my recollection) they weren't seen as geopolitical rivals to the US.

Maybe it has something to do with population size, but IMO it is more to do with their economic structure and system of government. Japan is a democracy, and they believe in markets. Since War 2 they also seem a little less pushy with their neighbours...