IMO they are two kinds of tests:
1. Tests to help you retain information.
2. Tests to evaluate your knowledge.
Assuming this question belongs to the first kind (memorization) and the answer is in a textbook being studied, then this is a good question.
Space Time Repetition systems such as Anki or Mnemosyne or SuperMemo are based on 2 concepts: (1) knowledge fades overtime unless reactivated and (2) asking questions is very effective to activate knowledge
Remember, we're talking about the benefit of questions that encourage the ignoring of nuance.
- it's more time-consuming to create good evaluation questions.
- it's more time-consuming to provide a nuanced answer.
- it's more time-consuming to evaluate nuanced answers.
If the purpose of the tests is to help students retain the knowledge they've been recently exposed to, then the first kind of tests are more effective. That is, the teacher will be able to provide students with more tests, thus helping them retain more in a shorter amount of time for everyone.
It's a compromise.
I'm thinking type 2 can have multiple choice, but then there's only 1 answer that can be correct.
Type 1 can have multiple choice, but puts multiple correct answers and expects you to pick the one that is most directly covered in the class, marking the other correct answers incorrect. That, to me, is testing information retention without nuanced knowledge.
We don't have the full test, so maybe the teacher had a preface saying "In the context of book XYZ...". That is what I do when I create flashcards for myself. I specify what knowledge I am testing. We may also assume it was implicit for the students.
I could also imagine that forcing the student to make one choice is a feature, not bug. For example this decision may teach the student that (1) not everything is binary and a single book has no absolute truth, (2) to move forward, you need to make a choice.
Regarding the second part:
> That, to me, is testing information without knowledge.
Memorization vs. Understanding is a false dichotomy. Both are required for proper learning. See https://www.coursera.org/learn/learning-how-to-learn.
Hey, you're flipping us around. Who was it that wrote this?:
> IMO they are two kinds of tests:
I'm the one that's arguing that it's a false dichotomy, that tests need to cover both and not one without the other.
> I could also imagine that forcing the student to make one choice is a feature, not bug. For example this decision may teach the student that (1) not everything is binary and a single book has no absolute truth
By writing a test that forces non-binary things to appear binary and presents the book as an absolute truth? That's going to teach them the opposite?
> (2) to move forward, you need to make a choice.
You're grasping at straws with this. You're telling me that marking correct answers incorrect is good because it teaches a life lesson?
My main and original point is the following: tests that only test memorization are good on their own ("Tests to help you retain information.").
You need both memorization and understanding to learn. Yes, some tests can improve both; but focusing on only one aspect - here memorization - is fine too.
For example, I've read Code Complete 2, and while browsing online I found that some of the claims in the book was not solid.
- https://www.sicpers.info/2012/09/an-apology-to-readers-of-te...
- https://www.lesswrong.com/posts/4ACmfJkXQxkYacdLt/diseased-d...
The point made in the above links are interesting but, because I remember reading this particular book, they are sticking more deeply in me.
Also it probably depends heavily on the topic.
For example in economic or philosophy, there are different schools of thoughts and I think it is valuable to know from which school a "fact" is attached to. And before learning about every school, it is probably easier to just remember where you first read it.
This is not critical, but maybe having this information can help you create new insights.
On the other hand, these tests are usually meant to evaluate learning progress and are not themselves thought of as teaching material. I find this quite unfortunate and would really wish that an exam were more like an individual learning session but here we are.
Thus, while this question as it it might advance understanding, it might at the same time hinder progress because someone will fail the exam for giving the wrong answer.
Or for spending too much time on a question that someone who failed to get the lesson answered in a second. This is an answer to what if the question is not meant to be answered "correctly" but just to stimulate learning. Unless the whole exam does not get graded - which would be great and hilarious at the same time - I fail to see the fairness here.