I've never understood people who say you can live too close to work. My best commute was a 5 minute walk. I lived in the city centre so everything was close to me. Why would it affect my work/life balance? When I didn't want to work I just did other things.
Maybe what is meant is if you live closer to work at the expense of living further away from everything else. That makes sense. But living close to everything was great (shame the job itself sucked or I would have stayed).