You can also turn off new contacts notifications which is something I also hated and discovered recently that you can do.