> Skip to content
FEATURED:
  • The Evolution of Race in Admissions
Sign In
  • News
  • Advice
  • The Review
  • Data
  • Current Issue
  • Virtual Events
  • Store
    • Featured Products
    • Reports
    • Data
    • Collections
    • Back Issues
    • Featured Products
    • Reports
    • Data
    • Collections
    • Back Issues
  • Jobs
    • Find a Job
    • Post a Job
    • Career Resources
    • Find a Job
    • Post a Job
    • Career Resources
Sign In
  • News
  • Advice
  • The Review
  • Data
  • Current Issue
  • Virtual Events
  • Store
    • Featured Products
    • Reports
    • Data
    • Collections
    • Back Issues
    • Featured Products
    • Reports
    • Data
    • Collections
    • Back Issues
  • Jobs
    • Find a Job
    • Post a Job
    • Career Resources
    • Find a Job
    • Post a Job
    • Career Resources
  • News
  • Advice
  • The Review
  • Data
  • Current Issue
  • Virtual Events
  • Store
    • Featured Products
    • Reports
    • Data
    • Collections
    • Back Issues
    • Featured Products
    • Reports
    • Data
    • Collections
    • Back Issues
  • Jobs
    • Find a Job
    • Post a Job
    • Career Resources
    • Find a Job
    • Post a Job
    • Career Resources
Sign In
ADVERTISEMENT
Teaching
  • Twitter
  • LinkedIn
  • Show more sharing options
Share
  • Twitter
  • LinkedIn
  • Facebook
  • Email
  • Copy Link URLCopied!
  • Print

Open-Book, Closed-Book, or ‘Cheat Sheet’? Researchers Test the Merits of Different Exam Types

By  Dan Berrett
December 12, 2012

Like many faculty members, Afshin M. Gharib and William L. Phillips have strong preferences for giving certain types of examinations.

Both men, associate professors of psychology at Dominican University of California, have kept up a running debate on the topic. Mr. Gharib likes open-book tests because the scores result in a normal, bell-shaped distribution curve and do not stress out his students.

Mr. Phillips favors tests in which students can prepare a crib sheet with material from the course. He has held fast to the belief that the act of preparing a crib sheet produces an added educational benefit.

We’re sorry. Something went wrong.

We are unable to fully display the content of this page.

The most likely cause of this is a content blocker on your computer or network. Please make sure your computer, VPN, or network allows javascript and allows content to be delivered from c950.chronicle.com and chronicle.blueconic.net.

Once javascript and access to those URLs are allowed, please refresh this page. You may then be asked to log in, create an account if you don't already have one, or subscribe.

If you continue to experience issues, contact us at 202-466-1032 or help@chronicle.com

Like many faculty members, Afshin M. Gharib and William L. Phillips have strong preferences for giving certain types of examinations.

Both men, associate professors of psychology at Dominican University of California, have kept up a running debate on the topic. Mr. Gharib likes open-book tests because the scores result in a normal, bell-shaped distribution curve and do not stress out his students.

Mr. Phillips favors tests in which students can prepare a crib sheet with material from the course. He has held fast to the belief that the act of preparing a crib sheet produces an added educational benefit.

Most professors, they acknowledge, go with a third option, the traditional closed-book style, which many see as the most-rigorous of test types.

To help settle their debate, Mr. Gharib and Mr. Phillips conducted a study of their students. The results appear in their paper, “Cheat Sheet or Open-Book? A Comparison of the Effects of Exam Types on Performance, Retention, and Anxiety,” on which they collaborated with Noelle Mathew, an undergraduate student at Dominican. The article was published recently in Psychology Research.

ADVERTISEMENT

They studied 297 students who took eight sections of an introductory psychology course and 99 students in four sections of a statistics course. Mr. Gharib taught the psychology sections and Mr. Phillips instructed in statistics. They used the same texts, assignments, and exams in each of their sections.

Students in the psychology course took all three forms of tests—open-book, closed-book, and one in which they could prepare a letter-size piece of paper with as much information as they wanted, an approach the researchers called a “cheat sheet” exam.

Students in the statistics course took the open-book and cheat-sheet exams. They did not take a closed-book test because it seemed unrealistic to expect students to remember long formulas, said Mr. Phillips.

Students in the psychology course scored best on the open-book exam, with cheat-sheet test scores coming in slightly lower, and closed-book exams last. Statistics students fared better on the open-book exams than they did on the cheat-sheet test.

“I think I won,” said Mr. Gharib.

ADVERTISEMENT

Pop Quiz

Two weeks after taking the second of the three tests, the students were given a surprise closed-book quiz to measure how well they had retained the material. To the researchers’ surprise, students retained the material equally well, regardless of the type of exam they had originally taken.

The researchers also found that students who do well on one type of exam also fare well on the other two, a finding that Mr. Gharib said was particularly important.

“Type of exam, it turns out, really is not important,” he said. “You can measure students’ learning and their ability on any type of test you want.”

Mr. Phillips agrees. “It kind of depends on what you want the student to get out of the class and what your expectations are,” he said.

Students also completed a three-question survey about which type of test they thought they would fare best on, which type they would study for, and which they preferred. Students took a pretest measure of anxiety on open-book and cheat-sheet tests.

ADVERTISEMENT

Not surprisingly, students preferred open-book and cheat-sheet exams over closed-book ones and reported the lowest levels of anxiety when taking open-book exams.

But, again, the results yielded a surprise. Students thought they would study most for the closed-book exams, but that view was not reflected in reports of their actual habits. Students in the psychology class spent the most time studying for the cheat-sheet exam, or more than four hours. Open-book exams yielded slightly fewer hours of study, while closed-book exams resulted in the least amount of time studying, 3.32 hours.

Statistics students, who took only two types of tests, also spent more time studying for cheat-sheet exams.

Another finding weakened Mr. Phillips’s argument for cheat-sheet exams. An independent scorer evaluated the students’ cheat sheets for organization and richness of detail. Higher-scoring cheat sheets, it turned out, had a weak relationship to performance on the exam.

“I was more adamant that the cheat sheet would result in better retention over all, and that wasn’t the case,” he said. “I think I might use more of an open book.”

ADVERTISEMENT

Both men cautioned against applying their findings too widely. They believe that disciplinary differences may complicate results. They also want to study the effects of take-home exams.

We welcome your thoughts and questions about this article. Please email the editors or submit a letter for publication.
Teaching & Learning
Dan Berrett
Dan Berrett is a senior editor for The Chronicle of Higher Education. He joined The Chronicle in 2011 as a reporter covering teaching and learning. Follow him on Twitter @danberrett, or write to him at dan.berrett@chronicle.com.
ADVERTISEMENT
ADVERTISEMENT
  • Explore
    • Get Newsletters
    • Letters
    • Free Reports and Guides
    • Blogs
    • Virtual Events
    • Chronicle Store
    • Find a Job
    Explore
    • Get Newsletters
    • Letters
    • Free Reports and Guides
    • Blogs
    • Virtual Events
    • Chronicle Store
    • Find a Job
  • The Chronicle
    • About Us
    • DEI Commitment Statement
    • Write for Us
    • Talk to Us
    • Work at The Chronicle
    • User Agreement
    • Privacy Policy
    • California Privacy Policy
    • Site Map
    • Accessibility Statement
    The Chronicle
    • About Us
    • DEI Commitment Statement
    • Write for Us
    • Talk to Us
    • Work at The Chronicle
    • User Agreement
    • Privacy Policy
    • California Privacy Policy
    • Site Map
    • Accessibility Statement
  • Customer Assistance
    • Contact Us
    • Advertise With Us
    • Post a Job
    • Advertising Terms and Conditions
    • Reprints & Permissions
    • Do Not Sell My Personal Information
    Customer Assistance
    • Contact Us
    • Advertise With Us
    • Post a Job
    • Advertising Terms and Conditions
    • Reprints & Permissions
    • Do Not Sell My Personal Information
  • Subscribe
    • Individual Subscriptions
    • Institutional Subscriptions
    • Subscription & Account FAQ
    • Manage Newsletters
    • Manage Your Account
    Subscribe
    • Individual Subscriptions
    • Institutional Subscriptions
    • Subscription & Account FAQ
    • Manage Newsletters
    • Manage Your Account
1255 23rd Street, N.W. Washington, D.C. 20037
© 2023 The Chronicle of Higher Education
  • twitter
  • instagram
  • youtube
  • facebook
  • linkedin