Chrome has this functionality, other Chromium-based browsers most likely as well. But how many users would actually manage access lists for extensions?
I believe more than one user would actually manage access lists for extensions but you have asked a really loaded question given that browser users are not being given the choice here.