They really should be asking on the second visit. I've enabled them for some sites (actually, this reminds me I haven't seen notifications for one in a while) but popping up before I've had time to assess the content is rude.