This is the right question to ask. Caffeine causes mood swings, anxiety, and poor sleep.

After over a decade of regular caffeine use, I stopped it entirely last year. The benefits were tremendous. The "decaf" subreddit is full of people with similar experiences.