This response makes me wonder how exactly you are answering the question. I can't image almost anybody giving guff for "honestly i've been working non-stop and just needed to unwind and clear my head".
Worse yet, I'm asked by friends and family why I spend my free time doing work(that I enjoy doing), and why I'm not dating anyone. "Aren't you worried you're going to get old and be all alone?" they ask. No, I'm not, because I've always had people around me. I just don't need them for every waking moment of my existence. "Don't you hang out with anyone?" they ask. I've got my neighbor, who's a good friend I see around once a week, my best friend who I see a few times a year, a female friend I see about twice a month, and regulars I'll see at meetups. The rest of the time I spend alone, and it's great. I don't need a gaggle of friends to be with on weekends. I actually don't want many friends at all. My time is valuable.
Nothing against people who live their lives differently than mine, but the least I could ask for is some basic respect when my life choices harm nobody else. I'm sure many of them are enjoying their lives. That doesn't mean that I would enjoy their lives, and it isn't my problem if some folks don't grasp that.