Random thought that just occurred to me: something I always wanted as a student but which is likely impractical because of the time it takes from the tutor, is to have an exam in the form of a conversation, where you can elaborate and explain and ask follow-up questions when you’re not quite sure, etc. This actually seems like something an LLM chat would be perfect for? Let the student talk to it directly and have it ask about whatever the course is about, and then have the teacher evaluate their ability to reason and explain various concepts.