I think it's only contextually illegal - on narrow streets, you might have to enter a bike lane, drive in a parking zone, or otherwise break a rule to have room to pass.