Not sure about in the phone, but in the desktop versions, you can click the (i)/Secure icon to the left of the website to review/change your permissions for the site.
For mobile, it looks like you can hit the vertical menu button in the top right, then the (i) icon, then Site Settings...