And everyone is drawn to the company of others in the workplace based primarily on interpersonal factors, not others' ability or performance or lack thereof.
Certainly, there are toxic personalities which can poison an environment, but they generally have some valuable assets as well.
Deciding to leave an organization because of its people is never a simple calculation.