That would be the normal way to do it at scale for this feature. Though with a small amount of users, I suppose they could just send the app a list of all the numbers they have and compare to your phone book...
What about - no ;P That's the worst idea I have ever heard ;)