I tend to term such a device a ‘handset’ for that among other reasons.