Passengers won't care, they'll be busy playing with their phones or working. All that useless time spent driving is suddenly productive, as if you were in a nice private train car. If a car passes the train on the highway outside, do you even notice as a passenger?
I think following the laws and driving calmly is a great benefit. Never once I have thought, "I'm so happy that Uber driver drove like a maniac weaving between lanes, and got me to my destination all of 4 minutes earlier. Yay".