You can have a separation of spaces within your home. I have a home office. The only time I go in there when I'm not working is if I left something there (and it's really nice that "swinging by the office to grab my earbuds" doesn't involve a commute).

As a result, I just don't think of that room as part of my home. I'm never tempted to go in there and use that room for something else. For the most part, it's as if that room only exists during the workday.