This is apropos for me because just yesterday I decided that it was time to bite the bullet and switch to Vim from TextMate. The resulting [temporary] decrease in productivity put me in a bad mood for most of the day, but then the rational part of my brain kicked in and I was wondering why should I feel guilty about making a long-term investment in productivity?
Now I don't want to project my own issues onto anybody else--the point is to think about why you feel guilty--but in my case I think I have guilt issues relating to geeking out going back to early childhood when my parents were really not very supportive of long computer hours doing who-knows-what. I realized that the need to be outwardly productive at all times is a form of extrinsic validation that I sometimes lean on too heavily.
Okay, so this is quite a bit different from your story, but I think some general advice is applicable here: just follow your passion and don't let guilt feed some sort of psychological negative feedback loop. If you feel guilty about something, make a conscious decision to either do something about it or decide not to, but don't let it eat away at you.
As for the low-tech thing, well just remember that a lot of developers waste a lot of time farting around with whatever new toys they can get their hands on. It doesn't necessarily make them better. You could live in a cabin, grow a garden and chop wood every day, and if you sat down and focused on the craft of programming for 8 hours a day you could still be a great programmer. In silicon valley in particular I feel that the value of downtime and cross-disciplanary idea pollination is underrated.