That's why you don't respond immediately. My policy is that if it's super important they'll either come by my office or they'll call me directly.

Anything else, and it gets looked at during specific times of the day. Once everyone is aware of this policy, they know that emailing me won't get an immediate response, and they accept that.