In life I tend to encounter two common patterns of intelligent people: those who had a good education and those who did not. I worry that when AGI comes it is going to be able to do all the things the smooth fast taking wily folks can do, and none of the things the educated folks can do, and we’ll accelerate not a slide into the singularity but a slide into inane banality.
How do you provoke a model into being wacky, challenging, and innovative?