My caffeine intake is basically nil, but I still often feel drowsy when I wake up, especially from an alarm. It's usually when I haven't sleept enough, but sometimes if I've been sleeping roughly enough, waking up from my alarm leaves me very drowsy.

Sleep is very complicated. Just because dumping caffeine fixed your drowsiness doesn't mean it'll fix everyone's.