33

In the last assignment I've given my students, one of the questions has two subquestions that go as follows.

  1. Explain how Theory X, as developed in Smith (2010) accounts for dataset A.
  2. Briefly summarize the additional data that, according to Smith (2010), fall under the scope of Theory X.

A number of students have submitted something along these lines.

  1. Something that is technically correct, but doesn't actually answer Question 1.
  2. Something that is technically correct and answers both Question 2 and Question 1.

What is the proper grade for this students? The three possibilities that I have in mind are:

  • Full credit: they have provided correct answers to both questions, even though the answer to Question 1 is embedded within the answer to Question 2.
  • Full credit only for Answer 2, no credit for Answer 1: they not only have to provide the correct answers, they also have to provide them in the right place.
  • Half credit for Answer 2, no credit for Answer 1: half credit because the Answer 2 contains more information than I asked for.

I'm inclined towards the second option (full credit only for Answer 2). Would this be appropriate?

Update: in response to some of the answers below, the problem is not that my questions are unclear, as a majority of the students have managed to answer them properly.

  • 18
    I'm sorry but frankly the third option looks a bit silly to me. To say the least. – o0'. Feb 25 '15 at 11:32
  • 29
    You can also consider option 1.5, which is half-credit for answer 1 and full credit for answer 2. Inform students in the future to answer questions where they belong and then adopt Option 2. – Compass Feb 25 '15 at 14:13
  • 5
    Option 3 may be required if your facility uses negative marking (to prevent exactly this kind of "hedge your bets" answer) – Jon Story Feb 25 '15 at 14:45
  • 5
    Whatever you do, don't lean on the idea that "if the question wasn't clear you should have asked about it". It's a capricious argument. Students will ask if they have no idea what the question means. They will not ask (and why should they?) if they read the question differently than you intended. – wberry Feb 25 '15 at 19:31
  • 4
    Remember that the purpose of any summative assessment is to grade what the students know, not how good they are at navigating exam papers. – Dawood ibn Kareem Feb 26 '15 at 5:41
18

From the level of detail you provide it is not entirely clear to me which option is the most fair one:

  • Possibility 1 seems fair if the questions were not entirely clear, i.e., it is reasonable to assume that a student really just misunderstood. If a large fragment of your course actually answered as you said, this may be a reasonable assumption.
  • Possibility 2 is my default policy for exams. It is not ok to answer "something" factually correct at some point, the answer also needs to fit the question. That is, if I hypothetically ask "What is A?" and "Also describe the alternative approach B", and the student brings up the right answers but mixes up A and B, she will get (fairly, as I think) a grand total of 0 zero points, or close to it. Of course this is only fair if it was obvious what was being asked. For example, if I had asked instead "Name and describe a really cool standard idea to do foo" (thinking about A), and the second question is then "Name and describe a more uncommon alternative way to do foo" (thinking about B), then purely mixing them up is not worth 0 points anymore.
  • Possibility 3 seems somewhat iffy. Detracting points for "too much information" opens a can of worms, and easily brings students into a "doomed if they do, doomed if they don't" situation where they lose points for too much as well as too little info. However, this is again something that can be fixed by having sufficiently clear questions. If I ask "Define C according to McFoo", and the student offers 3 alternative definitions (one being the one of McFoo), the two other definitions are not just additional information, but objectively wrong. The main point here is to prevent students from gaining points by just blurping out a braindump of "every piece of info on topic C", without actually understanding the question.

As said, from your question I am not entirely sure which case your situation actually falls into, however, it kind of sounds like Possibility 1 is fair in your specific case. If you are adamant that the question was clearly phrased and the students just misunderstood based on their lacking understanding of "Theory X", then Possibility 2 can also easily be justified. I would steer away from Possibility 3 in your case.

  • +1 another possibility if the questions itself were not clear, is to give full credit for question 2 and half credit for question 1 – Ant Feb 25 '15 at 13:33
  • 6
    @Davor No, that's not the reason (at least for me, can't speak for xLeitix). The reason is that students quickly learn that throwing in some keywords here and there makes them pass the exam. Mixing answers to different questions always smells like "I only know some bits, and I don't have the wider context". So it's completely reasonable to grade 0 points if someone answers the wrong question. – yo' Feb 26 '15 at 14:43
  • @yo' Yes, that's the idea, but I am pretty sure Davor was just trolling, anyway. This is one of the unfortunate side effects of having more external people visit our site, I am afraid. – xLeitix Feb 26 '15 at 15:42
  • @yo' - Do I need to quote that again? OK, here we go: the student brings up the right answers but mixes up A and B. Your strawman seems hardly related. – Davor Feb 26 '15 at 17:05
21

What is your purpose of a grade? If it is a numerical certification of their knowledge, full credit is the right choice, as they indeed have shown to know the answer to both questions. If the assignment didn't have time pressure, you may consider applying a small penalty for the not so good organisation, but be prepared to have it challenged.

Don't penalise adding extra, factually correct, information. Other professors welcome it, and even, the expect you to understand that the question has unwritten sub questions that should be answered too for the full credit (I had one of these in high school, and "give three examples of mammals" meant also "explain what they are and why are they mammals, or I will only give you half").

Lastly, if several students have made the same mistake, consider that maybe the questions are not clear. I must say I don't quite understand the difference from your excerpt.

  • 16
    Full credit is clearly not justified: the student has not demonstrated understanding of the first question -- rather the reverse, in fact. I might well take off at least some credit on the second question as well, as the student seems not to have completely understood it. – Brian M. Scott Feb 25 '15 at 10:51
  • 12
    +1 to @BrianM.Scott's comments. Knowledge involves not only knowing a load of facts, but also understanding how to organize them. When you are asked a specific question, you should answer that specific question, not answer question 1 indirectly in your answer to question 2. – Stephan Kolassa Feb 25 '15 at 11:10
  • @BrianM.Scott Seems to me you're directly contradicting and/or not following David's point here. In your class, you can choose to teach and/or grade the skill of literally following test instructions. Not all teachers need to grade for that. Perhaps you just meant to state the approach you use in your own classes? – Dronz Feb 25 '15 at 19:55
  • 2
    @Dronz: I am disagreeing vehemently with David: I do not consider his approach acceptable. (Of course he is still free to adopt it in his own classes.) And I am not advocating teaching or grading the skill of literally following test instructions. I am pointing out that if a student offers a non-answer to one question and then incorporates the answer to that question in the answer to one that asks for something quite different, there is good reason to think that the student did not in fact fully understand what was being tested. – Brian M. Scott Feb 25 '15 at 20:02
  • 2
    @BrianM.Scott Are they being graded on their understanding of the question, or their understanding of the subject matter? – Random832 Feb 25 '15 at 22:31
17
  • Possibility 1 would not be fair as the students didn't manage to understand the questions correctly.
  • Possibility 2 could be applied but is very rigorous.
  • Possibility 3 is unfair as the students answered the question correctly and haven't written anything wrong.

I think you are missing a fourth option, full credit for answer 2 but only partial credit for answer 1. While I understand that one could argue that the students answered both questions correctly I also think that understanding a question is part of the correct/perfect solution and should therefor influence the credits. But it should also be acknowledged that the students have shown that they have the knowledge to answer both questions correctly.

If some students then want to argue with you regarding their answer you can always tell them that if they think a question is unclear they should always ask.

  • 9
    Possibility 3 is unfair — [citation needed] Giving more information than necessary arguably demonstrates weaker mastery of the material—and therefore arguably deserves a less credit—than only answering the stated question. It's overly harsh, in my opinion, but as long the policy is applied consistently, it's fair. – JeffE Feb 25 '15 at 15:11
  • 4
    @JeffE arguably demonstrates weaker mastery of the material[citation needed] – Mindwin Feb 25 '15 at 19:23
  • 1
    @JeffE some graders do require answering more material than what they ask. The student may just be being cautious about it. Unless it is stated that "answer only what you are asked", it would be unfair to take credit for that. – Davidmh Feb 25 '15 at 21:11
6

The purpose of an exam is to establish the students' mastery of your subject, and absolutely not to test their mastery of taking exams.

If we give anything other than full marks for a correct answer, we have fallen into the trap of trying to mark their mastery of exam technique, a non-skill of no use in the real world, as opposed to marking their mastery of our teachings and our subject.

Oh, maybe if we're trying to train FAQ authors? Yeah, then it matters that they give the exact right info at the exact right point in a document I guess. But... I'm pretty sure you aren't.

the problem is not that my questions are unclear, as a majority of the students have managed to answer them properly.

Consider the following sentence: "This road junction is not unsafe because a majority of drivers pass through it safely." What percentage of drivers would have to have accidents at a junction, before you would call a junction unsafe? Did fewer than this percentage of your students make this error?

Of course not. You wouldn't be here asking that question of such a low error rate. Your question was unsafe, and in fact, I'm willing to bet that I can predict exactly how they interpreted it:

A) Explain Theory X, as developed in Smith (2010).

B) Briefly summarize the additional data that, according to Smith (2010), fall under the scope of Theory X, and say whether/how this applies to Dataset A.

That's how they interpreted it, isn't it?

To claim that your question was perfectly crystal clear, based on the fact that fewer than 100% misinterpreted it, is to disingenuously ignore the fact that several intelligent and hardworking students who have fully mastered the question's subject, all made the exact same error when faced with this question, and someone who didn't know the subject or even have the full question (me) was able to predict the specific misinterpretation that they made.

Either:

  • Full marks; or
  • Be prepared to justify 1) why you are marking exam skills rather than course knowledge, and 2) why you had a consistent error of interpretation from the completely-correct responses, which you disclaim any responsibility for and instead put down to... what, exactly? It's not ignorance, it's not stupidity, so what trait are you ascribing it to, and marking it down for? Failure to re-read a question enough?
5

I wouldn't create a policy for this. I would go on a case by case basis and judge how much it feels like the student understands it given their answers.

When the student writes too much, there are two options: 1) It shows a lack of understanding, or 2) It shows good understanding. I would penalize #1 and, if I was going to penalize #1, it would only be fair to not penalize or even to give a bonus for #2.

I would also keep in mind that tests are indeed high pressure environments and therefore have pressure induced errors therefore not adequately demonstrating the student's true understanding.

3

I suppose the real answer is whether you consider these questions to be concatenate or discrete to one another. If you treat them as concatenate, then it makes sense to look at their answers holistically to tease out whether they understand the material. In such a case, they might earn full points, simply because they have demonstrated that they understand the material

If you treat them discretely, then you should simply be as systematic about it as possible.

I would suggest the following logic:

IF student response to Question 1:
    Fulfills the requirements of Question 1, assign full points;
    Partially fulfills the requirement of Question 1, assign 1/2 points;
    Does not fulfill the requirement of Question 1, assign 0 points;

IF student response to Question 2:
    Fulfills the requirements of Question 2, assign full points;
    Partially fulfills the requirement of Question 2, assign 1/2 points;
    Does not fulfill the requirement of Question 2, assign 0 points;

This is an easily-defended manner of grading. If a student challenges you and states that they answered Question 1 in their response to Question 2, you can concede that they did, and inform them that they would have gotten full points had they done so in response to Question 1.

I would suggest, however, that your third option is not only unnecessary, but arbitrary. Have you stated, clearly, that students should add absolutely no extra content in their responses? It seems cruel to reduce points for such an easy mistake, particularly when, ex ante, student's are uncertain of what constitutes 'too much'.

1

I would probably handle it the same way as if question 1 was not in the exam and got that answer for question 2.

1

Grading must be completely objective. If I give a lesson: Balls are spherical and the primary color red has a shade called crimson.

and ask 2 questions of you, such as: 1. What is the shape of a ball? 2. What primary color is closest to the color Crimson?

and you were to answer with: 1. Violets are blue. 2. Rubies are red and almost spherical in nature.

I'd have to grade both with no credit as #1 is technically correct but it doesn't answer the corresponding question, and the second has the answer to both in it, but is not used in proper context of the lesson.

Sadly, when students play with their answers, it's difficult to tell if they learned the lesson. But, what I know from first hand experience is when a student plays with answers like this, they're bored and are likely to do well given a chance in an honors or otherwise advanced course.

Happy teachings!

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.