My side projects, in particular, are where I allow myself to roam freely, and I often end up prioritizing unimportant (but interesting) work that is only tangential to the core idea. When I am only accountable to myself, then it becomes too easy to get unfocused.
Perhaps the original question should be rephrased as "how do I keep myself focused when working on side projects, since I'm only accountable to myself."