If it were just an optional web standard, that might be okay. But it's a system that removes control from webmasters and hands it over to Google, and Google are using their incumbent advantage to coerce you into the AMP system. I can build a site just as fast as AMP without sacrificing the UX of the web itself in the process, and I intend to do so. But there are many businesses jumping on the AMP bandwagon because they think there will be an SEO benefit.
As a user, I hate clicking on AMP links by mistake. It's not even clear where you are, is it a website, is it still Google, how do I get to the website from here? Who even served me the content? It says it's from this website, but it wasn't?