What happens if the momentum of us AI-addled outlives the tribal knowledge on the sidelines?

I genuinely fear your scenario -- "AI was good enough for long enough to let the artisans with the knowledge die off" -- now it's idiocracy. :)

Although is this different than people who know how to build and operate a steam engine? I am not certain.