107

Example:

Q: Does Venus exhibit retrograde motion? (1 mark)

A: No. This is because Venus orbits the Sun and not the Earth.

The first part is correct: Venus does not exhibit retrograde motion. But the explanation is incorrect: the reason Venus doesn't exhibit retrograde motion is because it's closer to the Sun than we are. Mars for example also orbits the Sun and not the Earth, but does exhibit retrograde motion.

Do I award 1 mark or 0? On the one hand, for obvious reasons, the grading scheme only covers whether the student said "yes" or "no". Based on that, I should award 1 mark. Further, if the student hadn't written the incorrect explanation, then the answer is perfect, and it feels wrong to penalize the student for going beyond what the question asks for.

On the other hand, the explanation is clearly incorrect and the student should've known the correct explanation (it's part of the curriculum). It also feels wrong to award full marks for semi-incorrect answers. For example, if the student had written something silly such as "This is because Venus is made of Swiss cheese", do I still award 1 mark?!

Ideally, I'd award 0.5 marks, but for various reasons fractional scores aren't permissible.

Controversial Post — You may use comments ONLY to suggest improvements. You may use answers ONLY to provide a solution to the specific question asked above. Moderators will remove debates, arguments or opinions without notice. See: Why do the moderators move comments to chat and how should I behave afterwards?

  • Answers in comments and discussions about astronomy have been moved to chat. Please read this FAQ before posting another comment. In particular, all further comments about the astronomical accuracy of the example will be deleted. This really belongs to chat or on Astronomy. – Wrzlprmft Jan 24 at 18:45
  • 2
    IMHO that is not a yes/no question. If there wasn't a yes/no checkbox and instead there was a line to write on, as I student, I'd expect to give a (short) justification. So I think your premise is wrong. – Bakuriu Jan 28 at 20:01

16 Answers 16

254

You asked for a yes/no answer (which, as you've discovered, has its disadvantages) and got one plus some other stuff. You should grade the yes/no answer and ignore the other stuff. If you like, you could add a note like "You got lucky! This is actually because..."

The whole point of yes/no or MC questions is that you grade only the answer, and assume that type-1 and type-2 errors cancel out or are normalized out. That paradigm doesn't work if you don't uniformly ignore everything other than the answer.

More concretely: other students likely got this question right using the same incorrect reasoning, but didn't write their reasoning down. There is no way to identify these students; so, you need to make sure they get the same score as this student.

  • 135
    +1 for "other students likely got this question right using the same incorrect reasoning... [but you can't] identify these students" – J. Chris Compton Jan 23 at 15:22
  • 16
    I'd say "the whole point" of any test is to grade a students understanding of the material. It was decided ahead of time that a yes/no answer was good enough to determine that understanding, but now this student has given us clear evidence that they do not understand something. That makes the answer wrong. As far as the other students, all we know is that they got the right answer. They presumably understood. They also understood the question didn't ask for further explanation. – JPhi1618 Jan 23 at 19:32
  • 8
    The last paragraph is pretty sharp. – Randall Jan 24 at 2:56
  • 11
    @Alexander I wouldn't take that specific example (or say 'one student has put...'), because it effectively embarrasses or shames that student in particular (who went above and beyond to explain why), when more than one could have the understanding wrong, perhaps for differing reasons. It's simpler to simply (re)introduce the topic of why Mars is retrograde, and if asked why, simply say that based on the test results you feel students need a refresher. – SSight3 Jan 24 at 14:29
  • 18
    @JPhi1618 : You say "That makes the answer wrong." This is incorrect. It makes "that a yes/no answer was good enough to determine that understanding" wrong. Since the defect is in the assessment method, the corrective action is to improve subsequent assessments. – Eric Towers Jan 27 at 16:34
218

I think that if you would allow full marks for just yes/no without an explanation at all, then you should allow it here. Otherwise the question is flawed and can't be properly and fairly graded. But a note to the student would be good, also.

To be more precise, if it is possible to answer a question with inconsistent parts it isn't a valid question for examination. It should be clear and clean.

But your job is to educate, not to grade. Give the marks and write the note. And think harder about the questions you ask and how they are presented.

If the explanation is required, it is a different situation. In that case, and if you weight the explanation heavily for other students, then probably 0 marks is better than any other alternative.

  • 149
    "your job is to educate, not to grade" Rarely said. Thank you. – mickeyf Jan 23 at 12:37
  • 5
    This is a very good question - I hadn't even considered that the question itself doesn't specify the student needs to provide an explanation - the fact that they do anyway should not count against them, but leaving a mark that this is wrong (and why!) is absolutely the correct way to do this. – Zibbobz Jan 23 at 13:41
  • 7
    @Zibbobz - the fact that they do anyway should not count against them - I disagree in general. The issue, as SolarMike points out, is not having a clear grading scheme in advance. I often give problems where no justification is required, but state that they will be graded on what they write. This includes taking off points for writing down bad justification (serious conceptual misunderstanding, not minor calculation error) for the right answer. (Much more often, this rule means they get partial credit for the wrong answer.) – Kimball Jan 23 at 14:37
  • 7
    @Kimball Actually I completely agree with you - when the question specifically asks for an explanation as part of the grade, that explanation should be part of what they get graded on - but the key words there are when the question specifically asks - and in this case, the question did not specify that an explanation would be graded. In this specific case, it would be unfair to grade the student on this answer - and in the future, the professor should make explaining the answer part of the question explicitly, complete with its own allocation of points for an adequate explanation. – Zibbobz Jan 23 at 15:50
  • 9
    I disagree with the conclusion. "Your job is to educate, not to grade"; giving a bad grade for writing nonsense is also a form of education. – Martin Argerami Jan 23 at 16:50
37

Give him the point. If you want, mark on the paper "wrong reason" in red.

If you wanted to evaluate reasons, you would have made it more points and required an explanation. But you didn't. So treat it like a normal true false or multiple choice problem. Reason not graded, just getting the right answer. Luck allowed. Etc. Similarly right reason but wrong result gets hammered.

If providing an answer was required then I guess you could mark wrong any case where both answer and reason were right.

P.s. This is if you are the teacher. If you are the student, don't debate 1 point. Get it all perfect next time.

  • 3
    I debate 1 point questions on tests and the like simply as a matter of principle (but of course, I am respectful and not trying to bother the professor), though I do make sure to get it next time! – user45266 Jan 23 at 6:17
35

This is a discretionary matter, and different lecturers will treat it differently, depending on their own educational preferences. However, I disagree strongly with some other commentators on this thread. In my view, there is nothing unfair in marking a student down for unsolicited and incorrect information. Indeed, I would say that this is generally a good practice, since it ensures that the student is held responsible for the correctness of their assertions, even in cases where they offer unsolicited information. This implicitly gives the student some broader training in the importance of ensuring that they give correct information even when they choose to advance information that is unsolicited --- something that is a broader life-skill of importance.

In my personal practice, if a student gives me more information than was requested, and that additional information is wrong, this incurs a marking penalty just as if that information was part of the question. I warn my students in advance that this is my practice, but it is a justifiable practice even without giving a warning. In this particular case, if I were marking the question, I would not give the student full marks.


What kind of graduates do we want? We are training students to become professionals in difficult fields. So, in considering this issue, I think it is important to consider the implicit lessons we give students by what we penalise and what we don't. Imagine that this student graduates and practices in your field. Would it be okay if this practitioner gives unsolicited information to people on the subject area, and that information is wrong? Would you be comfortable working with a colleague who gives information to you or others that is sloppy and incorrect, but then he faces no penalty just because that information was not requested by others? Is that the lesson you would like to impart to your students? Is that what you want to teach them about the world?

  • 36
    Do you want graduates who never say anything for fear of being wrong? Marking off for incorrect, unsolicited information seems reasonable on an essay, where clear argumentation is important, but for a true/false quiz, it seems highly unfair to say "this is true/false" and then "surprise! I marked your correct answers wrong because I also saw incorrect stuff!" – cag51 Jan 23 at 6:30
  • 25
    Actually, unsolicited information that exposes a misunderstanding is hugely valuable. Even more so when communicating cross culture/language. I think you're solving the wrong problem here (even though the intention is good, and the problem of off-topic information is real). – Sean Houlihane Jan 23 at 9:32
  • 16
    -1 If this student had been trained to engage with the question minimally, in order not to lose marks, they would have just answered "no" and missed an opportunity to learn about retrograde motion. Whether or not learning to "keep quiet in one's ignorance" is valuable (very disputable), it must come second to learning Physics in a Physics class. – Nathan Cooper Jan 23 at 14:49
  • 10
    What kind of graduates do we want? [...] I think it is important to consider the implicit lessons we give students by what we penalize and what we don’t.” Agreed 100%. We should do our best to teach them to be accountable for what they say by being accountable for what we say. So if we said we’ll award a point on an exam question for writing “yes” or “no” (the correct one of the two), that’s what we should do. – Dan Romik Jan 23 at 16:28
  • 11
    ... Conversely, taking off the point teaches students the lesson that while they are required to always be logical and consistent, the people in authority are allowed to act capriciously and say and do anything they please because they hold all the power. Is that what you want to teach them about the world? – Dan Romik Jan 23 at 16:34
10

There are a few schools of thought here, and it really depends on your teaching style.

From a fairness perspective, you shouldn't mark this student down. I'm quite sure that there are a few other students in your class who could not explain why they got the right answer (a good number of them probably just guessed at random). Unless you have a system to find out who those students were and penalize them, I think you'll have a hard time justifying why this student gets marked down and all those other students are not.

From an instructional perspective, there is some merit to marking this student down. Students have a tendency to write down random stuff with the hope that something sticks. If you incentivize your students to write less bulls**t and more to the point, you are teaching them a valuable lesson. You will be signalling to this student that you care about how they reason about answers, and not just the final product. I know of some lecturers who give their students 1 point in essay questions if they write nothing, just to provide an incentive to not write nonsense.

I would lean towards a fair verdict, but this is really because your question was very limited in answer scope.

  • 1
    +1 I agree with your second big paragraph. I think that changing future questions to evaluate the reasoning separately might fix both problems. – user45266 Jan 23 at 6:18
  • 22
    You will be signalling to this student that you care about how they reason about answers, and not just the final product. – If you want to signal that, you should arguably issue an exam that actually asks for the reason and not just the final product. – Wrzlprmft Jan 24 at 18:55
  • @Wrzlprmft s/arguably// (in other words I don't think it's arguable) but otherwise you nailed it. Rewarding the other guessers who keep mum and penalizing the one who explains her reasoning is exactly the wrong approach. – Philip Jan 30 at 23:05
9

The cause of the problem would seem to be the lack of instructions on how to answer the questions.

If the exam paper clearly said "answer the questions with either yes or no," the answer given is wrong because the candidate did not follow the instructions. That might sound harsh, but that's the way the real world works, unfortunately.

If candidates were expected to explain their reasoning, the answer is also clearly wrong.

This is no different in principle from the converse situation where candidates are expected to show their working, and someone simply writes down the correct answer. If they really were smart enough to see the answer immediately rather than do the expected half-page of calculations, they need to learn to be smart enough to also explain why their answer is correct, in real life!

6

I would usually give no credit for a correct answer supported by incorrect argumentation, particulary when the argumentation contradicts the putative answer, is irrelevant, or is absurd. However, given the grade-seeking, formalist/legalist behavior of many students, it is imperative to indicate in the exercise statement that answers will be regarded as correct only if adequately justified. In the current case I would not give full credit, but would not give the 0 I would like to give, unless this had been my practice throughout the course and was known as such to students, because the problem or exam formulation should indicate what sort of answer is required.

It seems to me educationally irresponsible and entirely unfair to award points for an incorrectly reasoned "correct" answer. Such an answer reflects a lack of understanding, and should be graded accordingly.

Here is a concrete example, understandable to some. One asks a student if a given matrix is diagonalizable. One student makes calculations, indicative of conceptual confusion and poorly performed, that would clearly indicate that the matrix has nontrivial Jordan form, but answers that the matrix is diagonalizable anyway. A second student makes a minor arithmetical error that leads via otherwise correct argumentation to the erroneous conclusion that the matrix has nontrivial Jordan form and answers accordingly that it is not diagonalizable. Some seem to think that the first student should be given more credit than the second, when the second student has clearly demonstrated a high level of mastery of material and understanding. (Neither answer should receive full credit).

This isn't a hypothetical example. In mathematics and engineering exams this sort of situation occurs fairly frequently.

Grading serves to indicate whether certain standards have been met. Guessing, or obtaining accidentally, a factually correct answer does not meet reasonable standards for demonstrating understanding of content.

5

It depends on the actual title above the questions (if there is one). For example:


"Are these statements true?" (or synonyms):

In this case, the actual answer is only "Yes" or "No". There are two options: marking it as incorrect since it's not fully complying with the title (writing further information was not asked), or marking it as correct since its actually complying part ("No") is indeed correct (and potentially crossing out the non-compliant part).


"Are these statements true? Justify your answer." (or synonyms):

The answer would be it as a whole. In this case, I'd mark it as incorrect since it does not answer all the title's parts correctly and thus it's not fully correct.


In case there is no title, it becomes a difficult situation since the mark turns out to be subjective. Besides, the student would be in their right to complain about what they get.


Conclusion: always make your exams with clarity in mind, clearing all technicality loopholes for justifying wrong answers, and no one will be harmed.

3

Whatever you do, you need to do it consistently for all students. For this reason we have a marking scheme. Presumably, you are not the only person responsible for the course? Are you working with a professor or colleagues? Ask them what they would do and do the same.

If there is no marking scheme and each marker makes an independent decision — discuss and work out a marking scheme that everyone can accept. Then write it down and ideally incorporate into the questions to make students aware, e.g. You need to explain your answer - correct answer with incorrect or absent explanation is worth 0 marks. Then simply stick to it.

  • Except that not giving an explanation is a valid answer and was assumed to be valid before giving the test. The issue is that the student gave more information than needed. – The Great Duck Jan 25 at 2:39
  • @TheGreatDuck Still, we assess student's understanding and provide constructive suggestions for improvement. We do not just tick the "right" answers. By providing incorrect explanation student gave evidence of their lack of understanding. – Dmitry Savostyanov Jan 25 at 12:17
  • I’m referring to your paragraph about making schemes and the last sentence. – The Great Duck Jan 25 at 18:05
3

If you want to be absolutely right, treat the answer as wrong.

The purpose of marks is to accurately reflect the level of student's learning. If there is clear evidence that the student hasn’t learned the correct concept, marks should not be awarded.. unless you are grading their luck. (The student is clearly lucky here.)


But, really... marks are secondary. Won’t hurt if you give them the marks and make sure that they get the concept too. That’s your job as an instructor.

So, give them the points and explain the correct concept to them. Win-win for everyone.

  • 2
    In most institutions one's job as an instructor involves certifying whether students have learned such content. Grades do matter whether we like it or not, because our employers and our clients give them importance. They should be taken seriously, or one should go teach in a context where there are no grades (with the correspongind remuneration). – Dan Fox Jan 26 at 8:14
  • @DanFox: I don’t object to what you are saying. Therefore I’m not sure about the point you are trying to make. – displayName Jan 26 at 14:14
  • 1
    "But, really... marks are secondary. Won’t hurt if you give them the marks and make sure that they get the concept too. That’s your job as an instructor." In many institutional contexts, from the point of view of many students, and from the certification point of view it is not true that "marks are secondary". Like I think also you, I wish it it were otherwise. That it "won't hurt" just to "given them the marks" seems to be questionable from the educational point of view also. – Dan Fox Jan 26 at 14:21
3

It seems you were giving a point (a) to students answering "yes" for the correct reason, (b) to students answering "yes" and wasting their time by writing down the correct reason, (c) to students throwing a coin and answering "yes" because they were lucky, (d) to students answering "yes" for the wrong reason, and you ask whether you should give a point (e) to students answering "yes" and writing down the wrong reason.

Since you are willing to give a point to groups (c) and (d), it seems unfair to me not to give a point to group (e). (But if papers are returned to the students, the wrong answer should be marked as wrong).

Of course, asking for an answer and giving reasons would make more sense.

2

Where does this "grading scheme" come from?

If you made it yourself, cross it out and make a better one that gives zero marks for both "yes" and "no" and only gives marks for an answer with a correct explanation. Students should by this point know that an unexplained answer is worthless, unless the question specifies otherwise, and your example does not.

If you received it from somewhere else, don't ask strangers on the internet to adjudicate, go back to the person or organisation that gave you the grading scheme and ask them for a ruling. This is the only way that the grading can be fair between different graders.

  • 9
    Students should by this point know that an unexplained answer is worthless — Only if you actually tell them that an unexplained answer is worthless! If your exam only says "Yes/No", then you're only asking for "Yes/No", which means you must give full credit for a correct Yes/No. Students should not be expected to read your mind. More strongly: Students should be expected not to read your mind. – JeffE Jan 23 at 11:16
  • 1
    @JeffE But the example does not say yes/no. If it did then you'd have to accept yes/no otherwise it's a failure to answer the question. – Jack Aidley Jan 23 at 11:41
  • 3
    @JackAidley It only asks a yes/no question. If you want more than a yes/no answer, ask for more than a yes/no answer. Use your words. – JeffE Jan 24 at 2:13
  • 3
    Students should be expected to understand the conventions of exams — You're assuming that there are universal conventions for exams. There aren't. – JeffE Jan 24 at 13:52
  • 2
    @TheGreatDuck And where did OP say there were 5 blank lines? You and I might say the default is to assume an explanation is required, but not everyone has that default. Even different instructors in the same department might have different defaults. Even if your university has mandated conventions that everyone actually follows (which would be a miracle), you still have to be fair to new/visiting/1st-year students who haven't learned the default yet. Use your words. – JeffE Jan 26 at 9:12
2

Is this a standardized exam? Will the score acquired by the student affect his chances of getting into college? Will it be carried onto the future? If so, award full marks. You were not testing the mechanics behind it. There is a good chance that other students didn't know the right explanation either, and thus, on account of fairness, you should give the student full marks.

The question only asked the student to answer Yes/No to the statement presented. Consider this: on any given test, there are going to be a number of people who answered "Yes", but didn't give an explanation. What if they didn't know the explanation either? What if they just guessed it? What if they tossed a coin? There are lots of facts that we know without knowing why they are true. Plenty of students in your class would not have known the explanation.


If this test is not for some standardized exam and if it'll not have any bearing on the student's feature, we can throw the fairness criterion out the window entirely, and concentrate on the more important aspect of testing: to see if the student has gained the required knowledge. In this case, whether or not you award 1 mark will not matter. You have two options:

  • Award full marks, but leave a note.
  • Award zero marks and leave a note.

What you choose is entirely your preference. Ideally, you'd want to award 0.5 marks; but since fractional scores are not permitted, I'll make a case for (2). Students are most likely to review questions for which they are marked wrong. If something is correct, it's correct and most students wouldn't want to bother with it. If they're marked wrong on a question, they'd want to know why. A student might review the whole paper, in which case your comments would be noted in both cases; but this is less likely to happen. It'll also encourage a student to not go beyond what's asked in a question. You don't have to present everything you know to the examiner in a test. While "sticking to instructions" may not always bode you well in life, in a test, it will certainly help you very much.

0

I personally would award the point (but disclaimer: I'm not a professor), but probably implement other answers' solutions (like write on the test an explanation). I'd like to point out that if this one question or a similar one were worth a huge amount of points on a test, of course it would be necessary to award points because the question never asked for reasoning. That question could simply ask for an explanation to avoid this whole issue.

-2

A recommendation I usually give when someone has an analysis paralysis:

  1. Grab a coin. Head for 1, tail for 0.
  2. Toss it high, so that it will spins as long as possible on the floor
  3. During the spinning, your expectation will show up most. Which side do you DON'T want most?

After you have know what you want, you can know why you don't want it.

  • 1
    I use this a lot too but I simply ask if when it landed were they disappointed or relieved. – CramerTV Jan 23 at 20:30
  • 3
    What one person arbitrarily wants is not a good standard for marking a test. – Matthew Read Jan 29 at 21:18
  • @MatthewRead no, this is just a mean to get out of the analysis paralysis, so that the OP can be aware of what they actually prefer. After that, they can justify their preference and stick with it. – Ooker Jan 30 at 2:48
-3

Ask them to give a confidence score (1 to 5 say) for their explanation. A high confidence but wrong explanation suggests a real lack of understanding for example.

  • 9
    The exam is over. – JeffE Jan 23 at 11:08
  • 1
    I'm upvoting this answer but the real problem is with the OP's himself/herself needing confidence and expertise scores in astronomy. You can see it in comments and in the edit history of the original question. Astronomy has been "butchered" there. I have nothing against the technical terms "prograde" and "retrogade" but there's more to hard sciences than flaunting vocabulary and putting all efforts into making happy-go-lucky tests. I'd say a lot more: confidence, knowledge, proofs, and derivations. Voting was disgusting here. This comment is necessary. – Ken Draco Jan 24 at 0:41

protected by ff524 Jan 23 at 16:42

Thank you for your interest in this question. Because it has attracted low-quality or spam answers that had to be removed, posting an answer now requires 10 reputation on this site (the association bonus does not count).

Would you like to answer one of these unanswered questions instead?

Not the answer you're looking for? Browse other questions tagged or ask your own question.