A few times I've had it affect my dreams. I was working on a toy OS a couple of years back. Similar to the OP I would work on it for a couple of hours every night after my girlfriend went home. One time after I was working on virtual memory I had a dream where I was in memory and there pointers and stuff. It was really weird.