your health should come first as long as you can afford it. don’t forget your own words:

> It has caused my depression and anxiety to worsen and I think I'm possibly burned out.

that combined with your manager saying you took the easy way out makes it pretty clear - you made the right choice.

your former manager sounded afraid. of what to do with reduced headcount.