Japan has a relatively low cost of living (especially in rural areas), reasonably good social safety net, low drug use, high levels of familial support, and other factors that make it remarkable. It's pretty hard to become homeless.
But even in the US, where all factors are far worse, there is a surprisingly small percentage of the population that is homeless. The absolute numbers are much smaller than most people would guess (even accounting for under counting).
We tend to focus and exaggerate homelessness because it is so visible. Poverty in general is a much bigger and worse problem everywhere.
The bottom end is much lower than in west in general.
Over the entire week, I saw one obviously homeless person, one “maybe” and no encampments. It really was striking coming from the United States. ~3,000 homeless may be low, but they have drastically fewer than us.
Homeless in Japan don't panhandle or really bother regular people.
My impression from XX years in Japan is there is a strong ethic of "don't bother other people with your problems" so the homeless generally try to keep to themselves.
Especially if you know anything about Japanese.