I hadn't realized it, but yes, this is exactly the experience I expect. The AMP page is like a modal I front of the actual site. Or that's how I think of it anyway.
They click the X or OK on the message, the message disappears, the site stays.
If you can find a website where the cookie warning’s X button redirects to your last Google search, please do so.