There's a great presentation about Google's self-driving car here (check the second half for video of the real-time telemetry that it gathers):
One of the things that I found really interesting is how the car inches forward at a stop sign in order to show the "driver's" intent to other drivers. Lots of actions that seem to be second-nature for human drivers have to be carefully emulated here.