They might not know that they're part of a harem if they're struck by the man's good looks and there's asymmetric information.