There's ways Google could fix this without AMP, such as factoring in total page weight when ranking mobile search results.
Then again - any site with good performance can be made unusable by crazy marketing people who wants [insert tracking tool here] on every page or similar.