Is it? If I understand it correctly, in Japan, if you have a valid residence card, you can use that to enter the country. That is not true for the US (if you consider I-94 the US equivalent of residence card)
There are some technicalities -- your passport has to carry the re-entry permit, but it's affixed to everyone who requests it at the port of exit, granted it's up to 1 yr.