It makes driving pretty stressful because it makes people much less predictable. When I commuted to Berkeley I would often joke/not joke that Berkeley pedestrians were trying to make me kill them with my car.
But a different weird thing is that being a pedestrian in Berkeley turns you into one of those people who is trying to die by car. I was more cautious than average (read: acting like a normal pedestrian somewhere else), and it was annoying and maybe dangerous for everyone else.
That may not seem clear, but it's analogous to someone being "nice" at a 4-way stop and letting everyone else go even if it's your turn. It's not "nice," because it delays and confuses everyone who now has to cautiously navigate a potentially dangerous situation instead of just following a simple procedure.
Similarly, cars stop for people in Berkeley. That's how it goes. If you act like they don't, then you get awkward standoffs between people and cars each not trusting the other to go first, all while traffic piles up behind the cars, and other pedestrians are now interleaving in between the cars in the jam. If you're on foot, you should just step out into road and cross it, after a perfunctory check, otherwise you're gumming up the works.
I don't like it, on either side, but it's not possible to unilaterally do better. You just have to go with it.