As a solo dev the biggest productivity booster for me, from a physical and mental aspect, was purchasing a whiteboard. It honestly feels like some sort of hack. Prior to having one I would use pen and paper but that didn't quite scratch my itch - if I made a mistake I would have to scribble it out and that space was now wasted. I can't quite explain why but on a whiteboard my brain juices just flow. Made a mistake? Wipe it off. Need more space? Wipe it off (or purchase additional whiteboards).
My high school maths teacher once said something that has stuck with me since - "When you're stuck on a problem, start fresh on a blank piece of paper." - he must've meant a whiteboard ;)