That's cool because it means you can actually do that if your manager is bad. In some countries there are no jobs so all you can do about having a bad manager is... nothing.
Are you talking about workers in general, or software development in particular?
In software development, I don't remember a time in the last three decades where a skilled dev couldn't find other employment with relatively little trouble. Of course, in some periods it was easier than in others.
Like if you have tenure at a University or are in public union.
Seems to me those jobs also often have really bad personal chemistry.