Digital Grading Follow-Up

THE BACKGROUND
Back in March, I wrote a post called “Want Some Free Red Pens?” on my dream for digital exam grading. In my ideal world, I’d remove all the paper from my office entirely. Having only digital copies of exams would be splendid since I could get a lovely potted plant to put in place of my institutional-looking filing cabinet. Last semester, I did accomplish my goal of grading an entire set of exams without using any non-digital ink. Now I finally have the time to tell you how it went.

The exam was for our “Introductory Calculus” (MATH 120) course. It was the third exam of the semester and I had about 30 students enrolled. I gave the same exam I would have otherwise — it wasn’t an online test. If you’re really interested, you can find a copy of the test here. I photocopied it like usual, and my students took it like usual. I did choose 1-sided copies over my usual preference for double-sided to help with the scanning task.

THE PROCESS

  1. Write, photocopy, proctor, collect exam. Alphabetize exams by student lastname and remove staple.
  2. Scan exams to PDF files using department’s Xerox machine; export as e-mail attachment to myself.
  3. Use husband’s perl script to “pull apart” multi-exam PDF file into 7-page segments. Rename files “lastname-exam3.pdf”. Transfer each file to iPad and open in GoodNotes.
  4. Correct each exam, save graded copy as “lastname-exam3-done.pdf”, compile exam grades, and upload grades onto our LMS.
  5. Use LaTeX’s “pdfpages” package to combine each annotated exam with a very thorough “Solution Key” (with comments, hints, suggestions, etc) at the end. Send each student an e-mail containing their exam’s feedback with the Solution Key & notification that official exam grade is available on LMS. [This was done to avoid FERPA issues about sending graded assignments, or grades themselves, over e-mail.]
  6. Save un-graded exams in my filing cabinet in case any student wants to pick theirs up. (As it turned out, no one did.)

THE GOOD THINGS
Here are the things I did like:

  • No crayon marks! No spilled orange juice! No paper shuffling! No page flipping! No running out of ink! Grading at home with a toddler is a tedious process, but being able to get in eight minutes of grading while also providing parental supervision was fantastic.
  • Forced Solutions. By giving every student a full Solution Key, I was able to write things like “See Remark on page 5” instead of re-writing the same paragraph of comments over and over again. Also, I didn’t have to feel guilty about printing thirty copies of said Solution Key, and I knew each and every student had been given the chance to see the solutions. (Usually, I upload the Solution Key to our LMS, but not every student bothers reading it, which is weird.)
  • Grading was Fast! During the “active grading” phase, I think it went faster than grading on paper. I didn’t have to spend time turning pages. I could Copy-and-Paste similar remarks from one test onto a different test. Because I didn’t need as much physical desk space to spread out, I was able to get in five minutes of grading here, four minutes of grading there, and so forth, so I think I was able to return the exams sooner than I would have otherwise.

THINGS NEEDING IMPROVEMENT

  • Hello, Copy Room. With about thirty students and a 7-page exam, the scanning task involved around 200 pages. It turns out that our Xerox machine does not like it when you ask it to scan anywhere near this many pages at once. After trying to scan 8 exams at once (56 pages), the Xerox’s “brain” would get hung up mid-process and a machine reboot was necessary. After this happened twice, I realized that I could only really scan 28-pages at once. So I set up four exams, pressed “SCAN”, and waited three minutes; lather, rinse, repeat. Four exams taking three scanning minutes meant about half an hour in the Copy Room I would have liked to spend elsewhere. (Thankfully, this wasn’t a total time loss since I could work on other tasks while the copy machine whirred.)

    A colleague let me know that elsewhere on campus, there exists a better copy machine that could handle this type of task more easily. But, accounting for walking to-and-from time, I am not sure this would have taken any less than thirty minutes anyhow.

  • Returning Exams. It had been my plan to use the LMS’s “Dropbox” functionality to return the exams. Unfortunately, I lost over an hour of my life trying to get this to work — without any success whatsoever. We use a Desire2Learn product, and after consulting back-and-forth with my Instructional Technologist, we concluded that you cannot return graded work unless a student has submitted ungraded work first.

    In other words, there is no way for me to return a PDF file to a student unless and until they have uploaded a (potentially blank) PDF file to me. So, basically, there is a way to “reply” to an uploaded student document, but there is no way for me to “send” a student an uploaded document first.

  • Big File Sizes. One has to be careful about writing too many GoodNotes comments. GoodNotes didn’t do a great job of compressing the PDF file size, and our LMS refused to allow me to send any file over 2MB in size as an e-mail attachment. Some of the exams were over this limit (too many comments) and others weren’t. To be fair, I am not sure if this is more annoying because of GoodNotes or more annoying because of our LMS. I also don’t know if GoodNotes has gotten better at saving from a GoodNotes document to an annotated PDF and keeping the file size smaller.

CONCLUSION

In the end, I don’t know if I’ll try this process again anytime soon. The biggest time drainers were the Xerox scanning & learning what didn’t work. If I were to do this again, I might investigate a better scanning technology. I would certainly ask my students to submit a blank PDF file to the LMS Dropbox, so I could “grade it” and instead return to them their graded test papers. My students really liked having a digital copy of their tests — it meant that when final exam week rolled around, they didn’t have to dig through their course materials to find their test. So, maybe I will revisit this idea sometime in the future? I’ll let you know if I do.

Digital Plan for Digital Action

It turns out that several people had some great suggestions about my wish for digital exam grading. I’ve decided to attempt it for my next Calculus exam, scheduled for Tuesday, March 26th. Here’s an outline of the plan:

  1. Photocopy exams single-sided and unstapled. Place a copy of each exam into an empty file folder.
  2. Subject unsuspecting Calculus students to grueling exam on these topics: Related Rates; Linear Approximation; Mean Value Theorem; Derivatives and Graphs.
  3. Alphabetize exams as they are turned in according to course roster. For absent students, place blank exam where theirs should be.
  4. Use department copy machine to scan all ~350 pages to a single PDF file and send it to me via e-mail.
  5. Thank my husband profusely for writing pdftk bash script that will take the single PDF file and break it apart, at every ~9th page, and rename the files according to last name (keeping alphabetical order in place). If this works, I should end up with 36 PDF files where each student has a file called “Owens-Calculus-Exam3.pdf” or something similar.
  6. Create Dropbox folders for the ungraded exam PDFs and the graded exam PDFs. Use GoodNotes to grade the exams on my iPad. Export the finished product back to Dropbox.
  7. Disseminate graded exams and grades to students.

It’s likely my first attempt at this will take longer than nondigital grading. One of the things I will have to do as I go is come up with “Correction JPGs” for those errors that happen most frequently and store them somewhere on Dropbox. I think these should be easy to add to each exam using the “import JPG” feature of GoodNotes. Usually I estimate that grading will take no longer than 10 minutes per exam. For my 36 calculus students, this means regular grading should take me about six hours. Hopefully this digital grading effort won’t take too much longer than this.

For Step 7, I also need to find out about FERPA. Provided I have a “sign for consent” on my exam header page, is that enough for it to be okay for me to e-mail each student her graded exam? Alternatively, is there a way using our Desire2Learn-Dropbox (on our Learning Management System) to return the exams to the students in some easy way?

Wish me luck!