When you visit an SSL encrypted website a little lock icon appears. It used to be when you visited a site with an RSS feed a little RSS icon would light up. I see no reason why notifications shouldn't be exactly the same. Give some ambient/unobtrusive notification of the capability. Don't force me to stop what I'm doing and make some decision for something completely orthogonal to what I'm currently doing.
You can already ignore notification permission dialogs.