That's not always the only reason, `people leave managers, they don't leave companies for greener grass`
If you're managed poorly the grass is almost definitely going to stay greener even when you are also on that other side. You're very blessed if you've never experienced that first hand.