From my own experience feeling trapped in a job that makes significantly less than $500k, and those of several friends, sure it may be a privileged position to be in, but the human mind doesn't care whether it should be feeling a huge mental burden.
Taking the leap and giving up a well paying but soul crushing job is hard. And it can feel really isolating and guilt inducing, when you certainly can't talk about it to your friend who is barely making ends meet and yet has a job seemingly less soul crushing. I'm sure they would tell you to go cry in your pile of money.
But work is most of life and I basically see finding work you like as a primary means to happiness. I've been scoping out interest for a coaching business around this topic lately and it seems that a lot of people have this problem. Heck, the "is freelancing the best thing ever or your worst nightmare" posts seem to come up every other day. I'm glad we are taking about it.