Hacker News Reader

Comment by professorthread | Hacker News Reader

I teach math-heavy economics courses. I found that grading homeworks for completeness and pairing the homework due date with an in-class quiz on the problem set material (taken in class the day the problem set is due, after the set is turned in) has reduced the incentive for students to use LLMs to complete the homework. Exam questions closely mirror what's on the homework, and exam grades correlate with students who make legitimate attempts on their homework. I can sus out legit attempts typically by handwriting. No erasing and fast writing means it was copied.

For grade weights, I weight the homework the lowest of any grading category, with in-class quizzes next, and exams scores the highest.

View on HN

Humm doesn’t this perhaps suggest you should do away with the homework, offer optional practice exercises and double down on in-class testing?

Perhaps they are also dealing with administration that says things like “The university insists that homework can't be optional”, as in the grandparent comment.

The university administration needs flexibility rather than draconian rules that dont work.

In any case, even if the uni insist on homework, the teacher can simply mark everyone who hands in their homework 100%. It is impossible for the administration to police it, or if they do, they'd need to hire someone to mark the homework (which conveniently solves the teacher's issue).

This is basically my solution.

Students who copy all solutions from LLMs maybe learn something, but it's like 5% compared to what someone can learn by doing the assignment without external help, or even by asking their peers. It's a bit disheartening, because I invest quite some time and thought in designing the assignments.

It was very different before LLMs.

Seems to me that requiring the homework and having it paired with the quiz works well in terms of cause-effect for the students.

Homework is actually useful practice if you’re not stupid enough to use an LLM to complete it.

I might argue that homework is, for mathematics, where the useful learning happens.

Yes it's all fun and games reading uni level maths nodding along to all the proofs until you're suddenly asked to do the exercises and suddenly nothing made sense and you are completely confounded by such an innocent looking question.

Exactly, it's the most important part of the math education, there is no point in memorizing definitions and theorems without putting everything into practice.

But it seems like the temptation to get perfect solutions from an LLM is too big for many students nowadays, they lack the maturity to understand that using LLMs for basic assignments is counterproductive.

It sounds like doing the homework is a form of practice exercises for the quizzes.

Homework is a tool for students. It is where they practice. I see my job as a prof to curate the problems I think will help students best prepare for the exams, and use that space to help them gain the intuition about the problems I don't have sufficient time to cover in class, like through an application. As my profs before me used to say, true learning comes in doing problems.

I find bright people who are self-motivated tend to do problems on their own, but this is not the modal student. This is like the top 10-15% of any class. The modal student is motivated by getting a degree so they can enter the working world, and sees coursework as an obstacle to that. They'll take any and every shortcut to get the highest grades with the least amount of effort. However, particularly with first and second year undergrads (but I've also seen the same behavior in grad students), they do not understand the purpose of pedagogy. That doing problems is where you learn the material.

So if you make homework optional, the 10-15% hold steady and do it but the bulk of the class will stop doing problems and tank their grades on the exams. They will not internalize the lesson after that first bad exam, because it is morally and practially cheaper for them to believe they had a bad day or that their professor (me) is just a terrible meanie who constructed an exam with problems they've "never seen before" and "had no connection to the lecture" (actual evaluation comments I've had when I've tried to the homework-optional method).

This is a great approach. I remember even pre-AI having issues where, at a big state school, basically all the answers to homework could be found online. Sometimes I made the choice to copy a homework and tell myself I’d catch up later. But the classes where there was a scheduled quiz right away just forced me to keep up.

Reply on news.ycombinator.com