My belief is that humans need to struggle through the process of learning to code, learning maths etc. in order to actually build the neural pathways to do the hard things AI can’t do yet. I feel some skills atrophying for me, and I worry even more for the younger people who will never get the chance to think without AI.

Another concern I have is that computers don’t need to be “generally superhuman” to replace 90%+ of office jobs. Computers have always been superhuman at some things, and LLMs have massively jumped the number of tasks that can now be automated to human-level quality or better. I’m not sure it matters if they scale to true AGI.