The US is not a beacon of consumer safety. In my European country, having your phone in your hand while driving is illegal.
The way that the separations of powers work in the US, basically all driving laws are set by the states. The rules for driving can and do change when you cross state lines in the US, sometimes significantly. It really doesn't make any sense to talk about specific driving laws in the US as a monolith.
I did laugh when of course sometimes they would pickup someone holding a chocolate bar while driving. While not necessarily the best thing to do with the one hand, not illegal all the same.