If you're feeling you'd be happier doing something else (and have the financial means to support yourself), just do it. Of course, it's harder when you also have a family to support but just have an honest talk to them and tell them how you're feeling. They'll probably support your decision.
It's a cliché but it's so true: life's too short to waste time doing something when our mind tells us we should be doing something else. That doesn't have to be something definitive either. Just try out something for a year or two and, if things don't work out, you can always find a new job (or maybe even go back to yours). ;)
I think many people here would like as fortunate as you are to have enough savings to quit their jobs and do something they're truly passionate about. You've worked hard to reach this point. Enjoy it! :)