I was quite surprised coming to USA to find out that only "text" part from cell phone usage by driver is banned. Unfortunately, human brain is still not evolved enough to be able to concentrate on the road conditions and on the conversation over the phone (for most people I've seen. I bet there are person who handles both simultaneously very well).
Nor autonomous cars are spread enough yet.
So I would say banning phone is good measure for now.