When I quit my third job, my boss told me "Karl, I know you hate me now, but in a couple years, you'll be making a million dollars a year and love me."
My response "Even if I believed you, I wouldn't do this job for a million dollars".
I still think I made the right choice by leaving. You have to live your life, and unless you really love your job, 80+ hours per week in the office is not living your life.
Also, I left that macro quant job by calling up Google and asking if they'd re-open the job offer I turned down 4 months earlier. It certainly helped that I had good backup jobs available.
In my opinion, a good boss can be loud, but must also smart and willing to hear, learn and teach, which are essential if you want to increase productivity and get your team full of smart and idea generating people together.
If you work for a mean and stupid boss, not only you'll work in hell, if the business failed due to their mistake, they'll probably put failure on their employees. Which is really bad if their false words got into the ears of your next recruiter.
Life is short, if something is obviously bad, don't try it.
Not saying its healthy tho; I think somepeople have simply mastered the 'embrace the suck' mentality when it comes to toxicity...they call that 'resilience'