I don't think that'd hold up against a legal review. It seems like an unreasonable position that some neighbourhood is so terrible that standing there for 20 minutes is an imminent threat. It might even be true, but that isn't a baseline a judge should really accept. The residents who live there obviously get through the day.

It may well have been very dangerous, but realistically it is hard to make dropping someone off in a residential area a crime. Threatening a driver with physical violence is definitely a crime though.

The driver is under precisely zero obligation to provide you a service. He provided the service asked for, too.

This is the address they gave to the driver,full stop. After the job’s done, you can’t just tack on extra requests like it’s a buffet. He delivered exactly what you asked, not a mind reading bonus round. It’s not his fault you gave the wrong address, he’s not clairvoyant.