In some places walking a few hundred meters puts you in a much better position for pick-up. Same thing in destination, propose a location that minimizes total travel time.
In cities like London, it’s often half an hour for every option, so the decision comes down to whether it’s raining and how well the tube entrances line up.
I once got off a night bus in Asyut, hailed a cab, hopped in and asked to be taken to the train station. The driver pointed out the window to the giant sign on the building across the street reading “Asyut Railway Station”.
Travel wouldn’t be the same without making silly mistakes like this. It’s where our stories come from.