In many areas of computing, I hate setting pen and paper exams.

Asking people to write Java (or whatever) on paper is crazy, it doesn't really line up with anything you would ever do in the real world, and expecting people to memorize the signatures of functions feels like a total waste of time.

On the other hand, we have to accept that LLMs are I think, at this point, better than over half of all 1st year University students, so we can't let students use LLMs, without either letting half of students pass with no effort, or making tests harder and failing half of students -- and that isn't a long term solution, as I imagine LLMs are just going to keep getting better.