Not in my experience - any time I've wanted to move it's been because I've felt that I'm underpaid, or that I'm not learning / making any career progress, or because I wanted to work on different kinds of problems. It's never been the people, people have been great, it's mostly [job description / organisational problems / lack of progress / lack of learning / salary].