Lucky you. Some people are more effected by caffeine than others. My eldest daughter reports similar ups and downs as I do, my other daughter reports no large effects.

Must be genetic, then.