To make sure your connections are secure. You want to make sure the recipient is who they are. So phone Numbers. Also probably because signal isn't a chat app.

It's an sms/ MMS end to end app.