Distracted driving is absolutely not an over-dramatization. We're not talking about a "second or two" as you so blithely put it; sure the action might only take a few seconds (let's be reasonable and say it takes 5 seconds to reach out, grab your phone, rotate it to the correct orientation, open it, read the notification, parse the information, return your phone to its holder, return your hands to the wheel, return your eyes to the road), but the context rebuilding _after_ the distraction is brutal.
We're taking 10 to 20 seconds of complete context loss. Your mind is no longer on "I'm driving" it's on "I guess I can swing by Cub and grab some milk, wait, did I already pass the Cub? Maybe Rainbow is open.."
You will have outdated information on the location of every object around you. Is the old lady still waiting to cross on the other side of the intersection? Is the cyclist still blitzing the red or did he make it? Is that SUV that was coming up still behind me, or has it merged into the turn lane? That batch of 3 cars crossing in front is gone, what was behind them?
To rebuild this context you need to do quite a lot. Basically you need a full cycle of the attentive, aware "I'm driving" brain loop we all use when driving to get caught back up. When you put your phone back are you doing a full 360 degree update? Check left, right, left? Lean out and see what the oncoming traffic looks like? Check all your mirrors, glance over your left and right shoulders to check the blind spots? Lean your head forward and back to glance around your A-pillar support blind spots?
Check your phone quick, put it down and take the right-hand turn you were waiting for? Bet you just checked traffic on the left and then gunned it, good chance to run over the pedestrian on your right who just determined that you were yielding, and stepped into the intersection.
Glance at your phone right as the lights turn green, pull ahead into the intersection and take your protected left-hand turn? Whoops you got T-Boned, turns out the green light didn't come with a green arrow as well, and you were supposed to yield to oncoming traffic. You lost that context when you glanced at the phone and all your brain remembers was Green means Go.
Distracted Driving is multiple times more dangerous than Drunk Driving. "I was at an intersection and stopped" doesn't mean distraction won't happen.