Externalities have costs and if they aren't accounted for then there's no incentive for reducing those.

Taxes are used as a way to account for the cost to society when products and services aren't pricing it.