Because going back not that long (non-SPAM) incoming voice calls were a priority interrupt. And they still sort of are for the relatively few people who call me in a regular basis.
Phone calls are not rude as a general statement. When my dad calls me it is not rude.