It's really more that many cyclists are in the way and aren't going the speed limit. You end up holding up a lot of traffic that is forced to go slower and that's annoying to everyone. to be frank, when you're driving a car a person on a bike taking up the entire road is annoying. This is why people really dislike bikes - they get in the way of people trying to get somewhere.