Ask anyone who has spent time in Japan, there has been a dramatic fall in blatant racism in the last 10-20 years. Yes, there are still rare instances, but the bad old days (before 2000) are gone. There is now a consistent, tiny, visible minority of non-East Asians that live and work in all major Japanese cities. And their children go to local schools. They are mostly working in low skill jobs like restaurants, construction, retail shops, farms, or factories. To be clear, many of those businesses require highly skilled people to run them, but the immigrant labour is doing low skill jobs. Also, there is a tiny fraction of those immigrant workers whom have trained very hard and are no longer low skill, like a bus driver or elderly care nurse.
Korea and Taiwan also have large numbers of immigrants doing low skill work.
My guess is that probably Taiwan is the most exposed to non-East Asian immigrants because they have a large population of foreign domestic helpers (clean/cook/child+elder care), so that is someone foreign in and around your house all day. I don't think Japan nor Korea has that system.