You appear to be confusing "avoid" with "never interact with".
If your professional life has required you to spend enormous amounts of time working very closely with people you don't like and/or don't trust, then -unless it has made you enough money to retire after a few years' work- please accept my condolences.