Personally that's already how I cross the street, and my confidence in human drivers isn't anywhere near so great.
I could easily see a bunch of kids deciding they'll go challenge the AI by dancing in the middle of a crowded street. Admittedly a millionth chance occurrence though. "Computer, take a picture, get me facial recognition, and report them to their parents."
Not perfect by a long shot, but unless automatic vehicles offer some similar pedestrian signaling capability, there will be issues.
There's also the question of what happens, say, when a vehicle is surrounded by a crowd of people with ill intent. This happens:
http://www.nbcnewyork.com/news/local/Motorcycle-Gang-Attack-...
Working on it. http://www.technologyreview.com/view/427743/how-do-you-know-...