You say phatic language is about maintaining the connection. If I understand this correctly then there's a role for it also with people one does know well. If you prefer referential conversation and meet someone who's completely restricted to that part of language, you may initially enjoy the conversations a lot. But, after some time (this could be months or years), despite their referential content they may appear increasingly "empty": you realise you're still completely replaceable as a conversation partner by a random new person.