I have similar symptoms when drinking coffee - although they kind of emerged. I’m drinking decaf coffee now, which tastes good enough for me to create the joy of a morning cup. I’m asking myself though, if this effect of caffeine has other reasons.
I drink dandelion coffee now. It's quite good.