I'm not advocating anything (I don't see a reasonable solution proposed to date), but I would like you to understand the problem.
Let's say you're traveling 10 miles in either bike (15 mph, very fast cyclist) or car (55 mph). It will take roughly this many minutes to travel:
(* 60 (/ 10 15.0))
40.0
(* 60 (/ 10 55.0))
10.90909090909091
The difference is half an hour, just going 10 miles. So really think a bit: if you're stuck behind $slow_traveller for 10 miles (curvy roads, hilly roads, whatever. Google for Palouse in WA if you want an idea of my local road system), you've just lost 30 minutes of your time. Fiddle the math how you like; it adds up to a lot more than 30 seconds. 30 seconds of hassle is what I get in town: not much.
Note that I live in a rural area and bike around as much as I can. So I swing both ways here, and I still say that bikes disrupt road infrastructure which isn't designed to handle them.