Unless you want to take time off regardless and have plenty of money to burn through, I'd save leaving your job until you are already making money with one of your projects. You can get pretty damn far just working on projects in your spare time.