That's why there are regulations. In Germany, for example, cabs can't deny a ride because you look weired, you smell, your are drunk, and similar things. They are required to take any ride. The levels are very high for them to deny a ride. The punshment would be to cancel their cab license.

Cabs are even required to take kids with proper safety and to take people with disablities like wheel chairs.