Correct. Sharing contact information is opt-in, and what gets stored on the server is only salted and hashed phone numbers, not even names. It’s just a way to find people on Wavelength whose phone numbers are in your contacts. Also, if you later choose to delete your contacts from Wavelength, everything stored on the server is deleted. The privacy policy makes this clear, I think.