You can revoke a link. Go to the shared album page. (clicking on the link will take you there) Click the options menu item and there is a toggle for link sharing that will revoke the magic url and token.
Or you can file feedback from the photo web page and just tag me in it.
Edit: I don't work on this stuff, but have seen it challenge me when trying to do this exact thing.