Yes, only a tiny minority of technical users will know what amp pages are and switch search engines to avoid them. But, a larger group will likely find the amp pages annoying, even if they can't precisely articulate why. This weakens google's hold on the market.