I find that caffeine made me anxious, so much that all the energy wasn't even worth it anymore, as I couldn't focus on anything from anxiety. After stopping, my anxiety has went down so much that I feel I'm able to do much more work then before, even if I'm doing it slower, because I can just relax and focus on what I need to do, without being distracted by every single intrusive thought I have and without the crash that inevitably comes every day after caffeine wears off.
I don't care about "health benefits" of coffee, to be honest. Caffeine is a crappy drug (for me), so nowdays I only save it for situations where I have to stay awake for longer than I usually can.