Yes, it is possible to match a phone number to a hash. (We are also looking at ways to make it more secure. If you have any suggestion, please let us know.)
However, hushes are not connected with the phone number, we created unique token for our user when the hush is created.
We needed phone numbers for our upcoming features. The newer version which won't need phone number to login is on its way.