I think --- I have no special knowledge here --- that nobody wants to do away with phone numbers more than Signal itself. That's what the "secure value storage" drama is about: using SGX to optionally vouchsafe an encrypted contact database, which would allow Signal to operate with opaque identifiers rather than contacts.
Notice that when you open WhatsApp, only your group memberships are populated. Individual contacts are not, because they are held on the original device.
My contacts aren't all my buddies and conversely many of my buddies in WhatsApp or Snapchat or whatever aren't in my contact list.
Trying to repurpose one data silo that contains contacts such as my dentist and a taxi firm and reusing it as 'buddies' is clumsy and ill-considered.
I would still guess that none is a bad assumption, however.
Edit: Spelling