> Luckily I gotten into a bad habit of placing all the money I will need for my taxes at years end into my account and just not touching it.

If you need to pay taxes in the US are you not supposed to be paying the estimated tax quarterly, not at the end of the year?

That way you'd get more stable expenses.