Phone numbers became a “bigger deal” when they started being abused.
People just started using instagram as a first means of contact because it felt less personal. It allowed for more “escape hatches” if it turns out that you don’t like the person so much.
If phone numbers allowed for varying levels of trust like instagram, it would work as a social network today like it once did in the past