Sounds like you've made your decision and you just want a push. And since you've asked here, instead of anywhere else, you know that we will push. And that's what you want. You are just a tiny bit insecure and want someone else to say it, but you've subconsciously guaranteed you'll get the push you want.
Ok then, I'll oblige.
DO IT! It sounds like you can afford it. Bad economic times are a good time to start. If you can survive through these times, you'll be positioned to explode when things take off. You don't have major financial obligations. You'll never regret quitting your job and taking a friggin chance. Take the chance. Embrace it. You only live life once.