I'm a very calm driver and regularly drive at or sometimes below the speed limit if visibility or other factors don't allow higher speeds. People do slow down and I never felt in danger - granted, this is usually at around 40 km/h instead of the limit of 50 km/h, but I can't imagine people are so careless they'd "run you off the road" if you weren't speeding.