Countries that do have significant immigration rarely see an increase in the native fertility rate. So the Japanese will die regardless*, immigration just means someone else will also inhabit their country.
In other words, you're offering a solution for the Japanese landmass, not the Japanese people.
*Assuming current trends hold for centuries, which they surely won't.