> if you newly join Signal, every Signal user in your address book will be notified

No. People who have your number in their address book will be notified.