Moxie has written "people [...] expect contact discovery to be automatic in their social apps." The only way for it to be automatic is to access your contacts.

This app is designed for those people, not "cryptonerds" (his word), and this is one of the concessions made to provide that ease of use.