People really should know better. It's not that hard to just be polite and avoid assumption. But I think you're doing the right thing by giving the benefit of the doubt. Whatever the reason for their behavior, a helpful and non-judgmental correction is more likely to get them to reevaluate their prejudices and maybe do better next time. As much right as you may have to be indignant it would only make them defensive.