I have done this twice in the last 12 months.
1. I left Microsoft to join a startup and took a >100k pay cut.
2. The startup was acquired, and I quit the parent company to go teach. Again, taking a sizable pay cut.
I’m happy with all the decisions (to join and to leave). After having a high salary for a few years, the happiness piece becomes far more important.