I've never used Uber, but this seems easily solvable with code.
Why not have you put the destination address into the app while you're waiting, and as soon as you get in the car, the driver can just say "go", and the GPS will start?
I'm kind of surprised it doesn't already work that way.