The problem with absenteeism is that while taxes are still being paid to maintain city services, the city doesn't function correctly, because there's weak street life.
Here's an article about the struggles of retailers in Vancouver's Coal Harbour neighbourhood, which has estimates of around 20-25% empty housing.
https://www.theglobeandmail.com/real-estate/at-vancouvers-co...