My experience is the opposite of yours. IE usage is the minority, so I don't feel bad if their experience is slightly worse than users using a better browser.

When they come and ask why X is slow, we send them over to firefox/safari/chrome, and they thank us.