If the silence is focused on getting yourself to the place where you have the best compassionate, win-for-all decision about how to engage, that's great. If the silence is basically a refusal to have a relationship based in candor, that can sabotage a relationship.
Lots of dysfunctional relationships have a dynamic where one person withholds and withdraws and the other person gets more and more anxious and aggressive because they are desperate for the other person to engage.
Taken thoughtfully and critically, the idea of allowing silence is excellent. We should certainly not fill silence just because we can't accept it.