I would say that we don't mind because we understand that there are many features on "modern browsers" that are not available on IE 9 and below, but yet are web standards (ok, not all the time). Hackers also tend not to use IE, so that also helps explain it.
It really only sucks for general consumer-facing apps to not support a large variety of browsers. Otherwise, for specific apps with more tech-savvy users, just supporting a couple of modern browsers is just fine IMO.