I believe there is a way to do this, if you use Do Not Disturb and make an exception for All Contacts.
Apple refuses to make it so you can actually manage how the "phone" can bother you, and I'm assuming they have some sort of deal with the carriers to be this way.