Related to this, I've been following a practice I call "Release Notes Driven Development", which is perfect for side projects. Don't worry too much about technical debt (although, keep it under control), but focus on the little time you have and how to make that as efficient as possible.
I wrote about it here; https://ma.ttias.be/release-notes-driven-development-rndd/