6

Recently, the online calculus class I TA for took their first test of the semester and the grades were horrific. Granted, this is my first semester as a TA so my expectations might have been high. However, the average was about a 50%. While the overall stress of the pandemic is definitely a factor, I also believe the structure of the exam played a significant role.

To prevent rampant cheating, students were given fifty minutes to take the exam but were not able to scroll through questions. That is, students could not look further ahead to see what questions were coming, nor could they revisit questions to change their answer. Does this seem a bit much to anyone else? Is worrying too much about cheating on tests, especially now, counterproductive? I mean, what if this semester's grades are inflated? It's only going to negatively affect the students who passed the class without deserving it as they progress through higher-level math classes.

Ultimately, I'm just a little discouraged as it seems we're more focused on gatekeeping grades instead of instilling knowledge.

9
  • 7
    I have not ever heard of any test where students where not able to revisit their earlier questions (although, of course, oral exams kind of work in this way). So for me, it seems to much, yes.
    – user111388
    Sep 18, 2020 at 6:58
  • 3
    @user111388: I think ABC feels that too much of his/her time and effort is being spent on procedural aspects of testing (especially new ones that have arisen as a result of COVID-19) and not enough time is spent on content assessment aspects of testing. Instead of "instilling knowledge", perhaps something like "gatekeeping knowledge" would have been better. Sep 18, 2020 at 10:27
  • 1
    This was a 60 minute test compared to how many hours of class? How much time were the students meant to have worked compared to class hours? How did the top students do? You know, those ones who work, attend and contribute?
    – Solar Mike
    Sep 18, 2020 at 11:34
  • 1
    @ABC See? You are not looking for an answer, you are looking for people to agree with you. Sep 19, 2020 at 19:53
  • 1
    @FedericoPoloni When I ask: "Do you agree with me?" you can respond, "No because blah blah blah..." This is how we can exchange perspectives and maybe help each other see things differently. That is however, only if you are interested in doing so, which you clearly are not. Stay safe.
    – ABC
    Sep 20, 2020 at 23:31

1 Answer 1

5

The testing situation you describe sounds like a multifactor problem with multiple possible solutions. It could be that a concern for cheating is the key concern here, but logically speaking, there are several distinct factors that could play a role. Someone can be concerned about cheating and still create a fair test. From an instructional design perspective, I'll name the most important factors I see and then list a few possible solutions.

Raw Difficulty / Learning Objectives

A math test can be easier or harder depending on what the instructor asks students to do, how much work they should show, and so on. For instance, compare solving an equation for x or finding the derivative of f(x) to interpreting a word problem, or solving a fairly simple equation with a more complex one. Compare working with separate questions with sequential questions that build off of the previous question's answer. The selection of these problems is often guided by an instructor's implicit or explicit learning objectives for a unit.

Time to Complete Test

In test design, instructors need to be very careful that students have enough time to give a fair attempt to each problem. Instructors can develop different rules of thumb. Some base completion time on how long it takes them to complete the test multiplied by a factor of two, three, or four. Others estimate the time for completing each problem and sum up a goal time, which might come out to 40 or 45 minutes.

Test Format

As you point out, many instructors don't account for how test format determines timing. In a paper test, a viable test strategy is to read the entire test and focus on easy problems first. In contrast, the testing systems in many Learning Management Systems either make scrolling through the test difficult or restrict movement between problems. So if a student is stuck on problem 3 of 9 and spends 15+ minutes on that one, they have no way of knowing when it's better to cut and run to an easier problem for them. Thus a test that might take 40 minutes for a student on paper would actually take closer to an hour.

Concern for Cheating

So the concern for cheating is a factor that affects how the instructor has implemented these other factors. You describe the time limit and test format as factors affected by a concern for cheating. In particular, students may have less time to share answers or look up information. Yet there are also other anti-cheating formats used. For instance, some professors have proctored exams, even online, which involve some kind of visual monitoring.


There are more factors, but what's to be done? You can toggle any one of these factors in order to increase the pass rate:

  1. Have fewer problems, or easier ones. In other words, adjust the total difficulty of the test so that students can complete it in the allotted time.

  2. Make the test time longer. Giving an hour rather than 50 minutes, for example, may have enabled more students to complete problems.

  3. Allow students to see the whole test when they start. That will let students prioritize the problems they know how to solve, rather than being at the whim of the instructor's own design or an RNG algorithm (if order is randomized).

  4. Worry less about cheating. This may mean adjusting any of the factors above, or it may mean rethinking the format itself. Think critically about whether your summative assessment needs to be a test, or whether it could be a project, homework, or something else.

Finally, any instructor who has been in the classroom for some time knows that they assign unbalanced assessments sometimes. It happens. If the end result is an average of 50%, an instructor has other options to mitigate the effects of unbalanced assessment on student outcomes, like grade curves. So whether or not the concern about cheating - or some other factor - produced a test that was difficult for students to complete, instructors have several tools for adjusting future tests and even addressing this current situation.

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .