I use WhatsApp and deny it access to contacts, it just presents the phone number in the app instead. After a short time one's brain associates the 'last two' of the number with the person.
totally possible, make them write you first.
There's an app on F-Droid that lets you initiate WhatsApp chats with just the phone number, without giving WhatsApp access to Contacts.