Because nobody strongly abuses this, it generally works fine and people go on with their lives around them. Even with the small neighborhood streets around Tokyo, you rarely see it being treated as an issue. At worst, if a truck is trying to pass, a quick honk will cause whoever is driving to rush out and move the car.
I do get disillusioned sometimes though, living in a society where people have a general level of respect for each other.