I think it also is a skill issue. People who are used to driving and navigating have more of a mental model of how the roads connect up, and can often correct an error without needing a GPS to explain how to reroute.
For example, in much of the country (less so in dense old urban areas) a lot of highway exits are "diamond interchanges" so it is trivial to, at any exit, get back on at the same exit going in either direction.
In general a good driver is pretty aware of stuff like this, especially in their home areas, so already has a pretty good idea of what to do if they miss an exit.
I think starting out GPS-based rather than starting without it and graduating to it eventually, is a big mistake, as it encourages this kind of stressful thinking because navigation is totally outsourced.
I speak from experience -- I'm an older millenial but nevertheless started driving with GPS because I never started driving till my mid 20s. My first couple drives, in NYC, were in retrospect very dangerous to myself and to others, as my attention was divided between the GPS and basic skills like lane maintenance.
To this day I'm always so much more comfortable partly memorizing or really just reviewing the rough outline of the route on the GPS while parked before starting the trip. It just feels good for the GPS to truly remain what it should be -- an assistant, not a master.