Unlike KDE, Gnome, OS X, etc, Windows' taskbar never shuts up. It always pops up annoying bubbles, makes clicking sounds, randomly shows and hides icons, and doesn't standardize the way you can add/remove icons.

OS X fails a bit in this area, too, as it's not intuitive to remove items from the menubar.