There are some indications that coffee's effect on anxiety depends on specific genetic pre-disposition:

http://www.nature.com/npp/journal/v33/n12/full/npp200817a.ht...

So not everybody will benefit from reducing caffeine intake. I think for most people, moderate caffein intake will actually have a positive effect on mood.