Toxic is so over-used these days that I think it often means "anyone I don't like at work".