You do not have to care if it is occupied. Tax the property tax. If the owner does not rent out the property, they'll pay out of pocket.