Sorry, but pretty much every argument you make looks like a different flavour of "I already put a lot of effort into mastering other ways, and now that I have they work fine for me, I don't see why we should switch to this one."
Because you seem to suffer from survivor bias, that's why. By comparison, I am a physics drop-out. Allow me to give you the view from below.
First, I know this pdf is about GA in relation to physics, but you're throwing all kinds of names and terms around that only make sense to people who already have studied physics; conscious or not, that's basically gatekeeping via jargon.
Claiming that we'll be unable to make sense of Goldstein and Spivak is also directly contradicting your claim that it's easier once you know the "more conventional stuff" - so learning one thing after the other is easier, but not the other way around? Why would it not be easier to learn the more conventional stuff after you have a solid GA fundation?
Both my own experience and that of many commentators here seem to indicate GA is inherently more intuitive to grasp than the disparate mathematics it connects, precisely because it all seems more logically structured and connected. And perhaps the people who didn't manage to get through have a better idea of what is more intuitive to learn that the people who did here. Similarly, given that GA connects so many things together, I have a hard time believing that it is a "specialised tool", but since I never had to deal with most of the stuff you mention I guess I can't be a good judge of that (did I mention the gatekeeping?).
Anyway, why should people first have to slog through all the other stuff, sometimes learning it more by rote than insight? We don't force kids to learn assembly or punch-cards before we let them play with a higher level programming language either.
I'm not suggesting we throw all the old physics books out the window, but we also managed to stop doing science in Latin. That removed a huge barrier of exclusion, has not lead to a loss of knowledge, and making the field more accessible to everyone has only benefited humankind.