I remember hearing that debris is a very hard problem that Google hasn't figured out quite yet. They can detect it just fine, but they can't tell if it's safe to run over or the car should swerve to avoid it. I think they said that currently they monitor other cars and use what they do to determine what they should do, but that obviously won't work if every car is a robot.