Exactly in the same spot, I've recently gone freelance where I'm paid by the hour and I've yet to take a holiday cause I always think this week of holiday will cost me $$$ (huge amount of money compared to what a normal one week holiday would cost).
Sadly, I will probably burnout soon and ignore that thought.