It's easy for the org to change around you (staff turnover, restructuring, management change) such that the team you leave is not the one you joined.

It's pretty easy to get "boiling frogged" into an intolerable situation and I don't think it reflects badly on employees who wait out changes for a while to see how they turn out.