I would think driving in the right lane is more dangerous on the freeway at least, because of onramps and offramps. I only drive in the left lane on a motorcycle.
Also risk to pedestrians goes up REALLY fast. At 30MPH a car has a 10% chance of killing a pedestrian. At 40MPH it's close to 50%.
https://law.lis.virginia.gov/vacode/title46.2/chapter8/secti... https://nacto.org/docs/usdg/relationship_between_speed_risk_...