What does this look like? Like asking children learning to read to demonstrate they can read Shakespeare?
A staple of modern education is scaffolding learning, where skills are incrementally learnt and build on previously learnt simpler skills. Much of what students learn in high school and early on at university is meant as a stepping stone to acquiring more applicable skills. Just like you can't start assessing learning abilities from Shakespeare, students simply need to be told whether they master those simpler skills before moving up. Doing away with assessing simpler skills just because AI can now perform them isn't the solution to addressing a lack of critical thinking.
What will need to happen is that early subjects will need to stop being used for gatekeeping. Rather than treating education as an adversarial game, we should make it a collaborative one and instead of trying to make it more difficult for students to pass assessments with AI (and mechanically making it harder to pass them without as well), we should give students a stake in learning what they need to learn.