Skip to content
ADVERTISEMENT
Sign In
  • Sections
    • News
    • Advice
    • The Review
  • Topics
    • Data
    • Diversity, Equity, & Inclusion
    • Finance & Operations
    • International
    • Leadership & Governance
    • Teaching & Learning
    • Scholarship & Research
    • Student Success
    • Technology
    • Transitions
    • The Workplace
  • Magazine
    • Current Issue
    • Special Issues
    • Podcast: College Matters from The Chronicle
  • Newsletters
  • Events
    • Virtual Events
    • Chronicle On-The-Road
    • Professional Development
  • Ask Chron
  • Store
    • Featured Products
    • Reports
    • Data
    • Collections
    • Back Issues
  • Jobs
    • Find a Job
    • Post a Job
    • Professional Development
    • Career Resources
    • Virtual Career Fair
  • More
  • Sections
    • News
    • Advice
    • The Review
  • Topics
    • Data
    • Diversity, Equity, & Inclusion
    • Finance & Operations
    • International
    • Leadership & Governance
    • Teaching & Learning
    • Scholarship & Research
    • Student Success
    • Technology
    • Transitions
    • The Workplace
  • Magazine
    • Current Issue
    • Special Issues
    • Podcast: College Matters from The Chronicle
  • Newsletters
  • Events
    • Virtual Events
    • Chronicle On-The-Road
    • Professional Development
  • Ask Chron
  • Store
    • Featured Products
    • Reports
    • Data
    • Collections
    • Back Issues
  • Jobs
    • Find a Job
    • Post a Job
    • Professional Development
    • Career Resources
    • Virtual Career Fair
    Upcoming Events:
    College Advising
    Serving Higher Ed
    Chronicle Festival 2025
Sign In
casting out 100

Casting Out Nines

Where math, technology, and education cross.

The Chronicle Blog Network, a digital salon sponsored by The Chronicle of Higher Education, features leading bloggers from all corners of academe. Content is not edited, solicited, or necessarily endorsed by The Chronicle.

If you don’t succeed, try again: Timed tests using specs grading

By Robert Talbert February 16, 2015

3546334679_abb69fc9ff_z
It’s been six weeks since the start of the semester, so it’s time for a brief update on the specifications grading “experiment” (although something being carried out in real life probably shouldn’t be called an “experiment”). So far it’s going quite well.

To continue reading for FREE, please sign in.

Sign In

Or subscribe now to read with unlimited access for as low as $10/month.

Don’t have an account? Sign up now.

A free account provides you access to a limited number of free articles each month, plus newsletters, job postings, salary data, and exclusive store discounts.

Sign Up

3546334679_abb69fc9ff_z
It’s been six weeks since the start of the semester, so it’s time for a brief update on the specifications grading “experiment” (although something being carried out in real life probably shouldn’t be called an “experiment”). So far it’s going quite well.

In this post I want to talk about timed testing under specs grading. This is an idea that’s not prevalent in Linda Nilson’s book on specs grading that got me started down this road. Mathematics is a subject that typically has a significant amount of procedural knowledge, unlike a lot of the subjects represented in Linda’s book. So there is a need to assess students’ ability to show that they can perform certain tasks on demand, without the benefit of virtually unlimited time and resources -- things like calculating derivatives, interpreting graphs, and instantiating definitions.

Don’t misunderstand: Those tasks don’t make up mathematics any more than the ABC’s make up the discipline of literature. But it seems reasonable to assess beginning writers on their ABC’s, and mathematical tasks that admit timed assessment are the ABC’s of the subject.

ADVERTISEMENT

Timed assessments were in the design of the Discrete Structures course from the beginning through the use of Concept Checks, which are 15 minute weekly quizzes over the “CC” objectives. But another layer of timed testing needed to be built to assess what I called the “CORE-M” objectives, the learning outcomes that are not basic (and can’t be assessed through objective, easy-to-grade items) and of central importance. The solution I came up with turns the whole process of timed testing sideways, and I really like it.

Four times during the semester, we’ve set aside an entire period that I call a timed assessment period. During that timed assessment period, students will work individually to do a combination of the following: (1) work problems over CORE-M objectives that are new to them, (2) re-work new versions of problems over old CORE-M objectives that they haven’t passed yet, and (3) re-work new versions of problems over old CC objectives that they haven’t passed yet. About a week prior to the timed assessment period, I put up a survey using a Google Form to have students go in and select the problems they wish to work during the period. Then, I go make out one problem for each CORE-M and for each CC objective that were requested.

I print out the appropriate number of copies of each problem and bring them to class on the assessment period day and lay them out on two tables. Students then come up at the beginning of the hour and get the problems that they want to work. They work those, and submit them when done. I then grade all of those on a Pass/No Pass basis using the specifications we laid out at the beginning of the semester. If a student Passes an objective, they are done with it, and they are one step closer to attaining the goal grade they wanted for the semester. If the student doesn’t Pass, then they can request that objective again during the next timed assessment period, at which point I’ll make out a new problem that assesses it.

At the end of the semester, we have the entire 110-minute final exam period set aside as a massive, last-chance timed assessment period. I do not give a comprehensive final exam in the class. Instead, the time is spent by students to make one last attempt at any CC or CORE-M objective they had not passed yet.

Here are some pictures I took of the process of putting together the first timed assessment period for the discrete structures class. Going into the assessment period, I had copies of the six CORE-M objectives available and a single pack containing all the CC objectives. I also had envelopes labelled with the objective numbers for students to return their work when done.

2015-01-30 09.50.34

Here’s how it looked when I got set up in class:

2015-01-30 09.56.39

This was the first assessment period, so we only had six CORE-M objectives. The next one, happening this Friday, has seven more new ones in addition to a smattering of older ones, so I’ll need more space. To avoid a human logjam when coming to get the papers, I released students by rows to come down one at a time to get their papers. It dawned on me as this was happening that this process was exactly like the process of receiving Communion at my church on Sunday mornings. I suppose that makes me some sort of Eucharistic minister.

ADVERTISEMENT

Some students decided to try all six CORE-M objectives, while others opted only to work on three or four of them, just to make sure they had time to work. One of the things I like the most about this system is that I will never again have the horrible situation of having to pry tests out of students’ hands when time runs out. That is, this happens (and did happen in this particular session) but each student can estimate how much time they need on each objective and only ask for problems that fit within the time frame; and if they misestimate, then no worries -- just try again at the next session.

Students handed in their work by putting the problems into the appropriate envelope, Actually it turned out the envelopes were a bad idea because they were only slightly larger than the papers themselves, and it was hard (and noisy!) to shove a paper into an already full envelope. At the second section’s period, I switched from envelopes to hanging file folders, and that solved the problem.

When it was time to grade, I pulled out the papers from each envelope/folder and alphabetized them (note to self: hire a student to do this in the future), and put them in piles:

2015-01-30 13.16.19

Then I graded everyone’s work on objective M.1, then everyone’s work on M.2 and so on. When the grading was done and Pass/No Pass marks entered into Blackboard, I laid out the papers on a big table and put together a packet for each student. This was simple because the stacks were alphabetized, so “Adams” was on top, then “Brown”, etc. and I just had to skim the current student’s work off the tops of the stacks and staple them together.

This was probably the same amount of work that I would expend on an ordinary timed test. Making out the problems didn’t take any more time. Grading them was about the same as for an ordinary test, with a slight speedup because I am not assigning partial credit to the work. (It’s only a slight speedup because I am giving feedback that’s more detailed than what I’d give on a regular test.) I have to alphabetize seven stacks of papers instead of one, and that’s time consuming but trivial. So really, once the logistics are ironed out, this isn’t that much more work. For future periods, I’ll have to make out new instances of problems that assess particular objectives, but that’s not usually very hard.

ADVERTISEMENT

And there are many things I like, and the students like, about this way of testing. First there is minimal pressure; if you don’t Pass an objective, just do it again later. Second, because students are choosing what they want to be assessed on, it makes them think intentionally about their preparation, rather than engaging in “studying” (which usually isn’t very purposeful) and showing up hoping they do well. Third -- and multiple students mentioned this as a positive -- this system does not let you disengage from course material once the test has been given. Because the test is not over yet! If you don’t pass, try again later -- but you do need to try again.

That last item is the main thing that makes me feel OK about not having a comprehensive final exam. If students are continuously revisiting material that they had not previously mastered and re-attempting problems to demonstrate mastery, the need for a comprehensive final exam diminishes.

As a last word, I think that even if you aren’t into specs grading and the whole no-partial-credit idea, this way of doing timed testing could still work. I should give credit where it’s due and say that the main idea for doing tests like this came from this Calculus 2 course that does not use specs grading. Just make up one problem per objective and assign a uniform number of points to each objective -- say, 10 points per objective. Then students do their work and submit it as described above, and you grade it using your system and rubric for partial credit. Then, the sum total of all the points earned flows into a large pool of points for “Tests”. Over the course of a semester using regular grading, you might give four 100-point tests; in this system you’d be giving 40 problems worth 10 points each. So it’s roughly equivalent in terms of contributions to the course grade. There are details to work out of course, but in principle this way of testing fits into ordinary courses in addition to specs-grading courses.

Want to continue the conversation? Follow me on Twitter (@RobertTalbert) or on Google+, and share this article on your networks using the social media buttons above.

Top image: https://www.flickr.com/photos/mpeterke/
We welcome your thoughts and questions about this article. Please email the editors or submit a letter for publication.
Share
  • Twitter
  • LinkedIn
  • Facebook
  • Email
About the Author
Robert Talbert
Robert Talbert is a mathematician and educator with interests in cryptology, computer science, and STEM education. He is affiliated with the mathematics department at Grand Valley State University.
ADVERTISEMENT
ADVERTISEMENT

More News

Protesters attend a demonstration in support of Palestinian activist Mahmoud Khalil, March 10, 2025, in New York.
First Amendment Rights
Noncitizen Professors Testify About Chilling Effect of Others’ Detentions
Photo-based illustration of a rock preciously suspended by a rope over three beakers.
Broken Promise
U.S. Policy Made America’s Research Engine the Envy of the World. One President Could End That.
Wednesday, June 11, 2025 Tucson, Arizona—Doctor Andrew Capaldi poses for a portrait at his lab at the University of Arizona in Tucson, Arizona on Wednesday, June 11, 2025. CREDIT: Ash Ponders for Chronicle
Capaldi Lab—
Research Expenses
What Does It Cost to Run a Lab?
Research illustration Microscope
Dreams Deferred
How Trump’s Cuts to Science Funding Are Derailing Young Scholars’ Careers

From The Review

University of Virginia President Jim Ryan keeps his emotions in check during a news conference, Monday, Nov. 14, 2022 in Charlottesville. Va. Authorities say three people have been killed and two others were wounded in a shooting at the University of Virginia and a student is in custody. (AP Photo/Steve Helber)
The Review | Opinion
Jim Ryan’s Resignation Is a Warning
By Robert Zaretsky
Photo-based illustration depicting a close-up image of a mouth of a young woman with the letter A over the lips and grades in the background
The Review | Opinion
When Students Want You to Change Their Grades
By James K. Beggan
Photo-based illustration of a student and a professor, each occupying a red circle in a landscape of scribbles.
The Review | Opinion
Meet Students Where They Are? Maybe Not.
By Mark Horowitz

Upcoming Events

Chronfest25_Virtual-Events_Page_862x574.png
Chronicle Festival: Innovation Amid Uncertainty
07-16-Advising-InsideTrack - forum assets v1_Plain.png
The Evolving Work of College Advising
Lead With Insight
  • Explore Content
    • Latest News
    • Newsletters
    • Letters
    • Free Reports and Guides
    • Professional Development
    • Events
    • Chronicle Store
    • Chronicle Intelligence
    • Jobs in Higher Education
    • Post a Job
  • Know The Chronicle
    • About Us
    • Vision, Mission, Values
    • DEI at The Chronicle
    • Write for Us
    • Work at The Chronicle
    • Our Reporting Process
    • Advertise With Us
    • Brand Studio
    • Accessibility Statement
  • Account and Access
    • Manage Your Account
    • Manage Newsletters
    • Individual Subscriptions
    • Group and Institutional Access
    • Subscription & Account FAQ
  • Get Support
    • Contact Us
    • Reprints & Permissions
    • User Agreement
    • Terms and Conditions
    • Privacy Policy
    • California Privacy Policy
    • Do Not Sell My Personal Information
1255 23rd Street, N.W. Washington, D.C. 20037
© 2025 The Chronicle of Higher Education
The Chronicle of Higher Education is academe’s most trusted resource for independent journalism, career development, and forward-looking intelligence. Our readers lead, teach, learn, and innovate with insights from The Chronicle.
Follow Us
  • twitter
  • instagram
  • youtube
  • facebook
  • linkedin