I have my phone set to silence calls unless they are in my contacts list. I tell people this whenever I give out my phone number.
Honestly I think this should be the norm. There's no reason for a random stranger to need to call you, if they want to reach out they can text or email, and I can't imagine many urgent situations where they can't text, can't forward the message through anyone in my contacts, and can't directly get the authorities to contact me.
The only exception is automated phone calls (e.g. call from a random number for an interview or to confirm 2FA where I can't do SMS), in which case I have to temporarily disable silencing calls. But systems where you get called once from a random number and can't call back are really awful for other reasons...