Service Workers do request permissions to run.

By design a SW can linger around if it has work to do. E.g. send a request when an Internet connection returns. But it needs to be queued when the tab is opened.

Off the top of my head I don't have any privacy concerns about SWs.