The only websites which would force you are:

- legitimate websites using this feature for valid purposes, such as to control devices on your local network

- targeted malware attacks trying to hack devices on your local network

I’m certain we will not start getting popups for this on any mainstream website.

So as long as this permissions thing is more than a simple yes/no dialog, I’m not worried.