If you live in NYC, cabs always refuse people to go to Brooklyn/Queens/Unwanted destination, eve though it is illegal to do so. The usual excuse: I am going out of my shift, and can't go that way. (this can be legit, but often it is not).
Next time don't enter your destination address, so the driver doesn't know where you go, and once you are in the car it is much harder for them to refuse you.