I would add a button, like "keep me updated", where people who want them, can turn them on.
I've added One Signal to my blog and enabled the icon mode (which doesn't ask for notifications but gives you an icon you can press). A surprising number of people did subscribe.
I’d be happier if browsers didn’t ask. Instead it’s a default no, and you have to go into settings to enable it.