> simply refuse all incoming calls while driving

Definitely the best course of action. Even just talking on the phone is very distracting. No way someone can have a full conversation going and still be giving the same attention to driving.