As an extreme example, imagine trying to find a stable husband and raise a family in a world in which every other woman treated sex as being valueless and beautiful women wandered the streets naked and giving it up to passers by.
It might be intolerant to prefer a society that isn't like that, but that doesn't automatically make it bad.
edit: Most of the responses here are missing the point because they're trying to take a side (in a deliberately fake, over the top scenario) rather than engaging with the concept. The behaviour of other people affects you and it's perfectly normal both to want to surround yourself with others who share your values, and to exert pressure to push wider society in that direction.