What's wrong with property as a means of production? Look, I'm not saying that stolen property is legitimate, even in the case of land. But that's a tricky issue, and perhaps some kind of "reset" is required (and arranged) in the future.
But if you acquire property legitimately, then there's no problem with it, even if it's not constantly in your possession, or occupied by you personally. Anything else would just not make sense. For example, if you park your car somewhere and go shopping, will the car cease to be your property just because you're not in it?
On a fundamental level, property can be thought of as "value you want to control". Something has value, and you get to benefit from it, because you've either produced the value yourself, or you've acquired it through a voluntary exchange (or contract etc). You build a house, the house has value as a dwelling, and you want to benefit from the house by either living in it or selling it to someone else.