It's a big world out there, and we're all just trying to get along.
I'm not in the least bit offended by swearing and swear liberally amongst friends, but curse words (taboo words) do exist, and some people are bothered by them. It's not an expensive courtesy to just not swear to strangers, so why not extend that courtesy?
I'm a big believer in the right to offend, but that doesn't mean we should do so needlessly.