...unless you have physical inputs, in which case you just have two or three glances at the screen, each quicker than the mirror check i know you're doing every few seconds.
the problem isn't that you're doing something with your free hand and sparing some mental capacity--else the manual transmission would be outlawed--it's that if you have a poorly designed car, you have to look away for long enough to lose track of what's happening around you.
good on you for realizing when you can't safely operate your car. but me, i just bought a car i can operate safely.