Specifically for VM's, something like Looking Glass (shared framebuffer so you don't need a dedicated monitor) needs the extra bandwidth to get the video signal through without tanking performance, especially at higher resolutions and refresh rates.
Aside from that, I agree it's not too big an issue for 95% of computer users, but it's something to keep in mind.