Like you, I find it extremely relaxing to build pointless things. Do you have the same trouble I do in explaining that this isn't "work" to people close to you?
No, I'm not planning on raising money for this side project.
No, I don't have a million users.
No, I don't know why people would want this.
No, it's not for a startup.
No, it's not related to my actual startup at all.
It's called having fun, damn it.
Of course, balance is important and I won't try to fool anyone -- it's something I'll likely always be working to improve.