I've experienced similar, but only when working hourly from home. I guess I feel responsible for distractions in my own house, but when I'm in the office I have no second thoughts about billing for the time where I did my best in the environment provided.