Skip to content
ADVERTISEMENT
Sign In
  • Sections
    • News
    • Advice
    • The Review
  • Topics
    • Data
    • Diversity, Equity, & Inclusion
    • Finance & Operations
    • International
    • Leadership & Governance
    • Teaching & Learning
    • Scholarship & Research
    • Student Success
    • Technology
    • Transitions
    • The Workplace
  • Magazine
    • Current Issue
    • Special Issues
    • Podcast: College Matters from The Chronicle
  • Newsletters
  • Virtual Events
  • Ask Chron
  • Store
    • Featured Products
    • Reports
    • Data
    • Collections
    • Back Issues
  • Jobs
    • Find a Job
    • Post a Job
    • Professional Development
    • Career Resources
    • Virtual Career Fair
  • More
  • Sections
    • News
    • Advice
    • The Review
  • Topics
    • Data
    • Diversity, Equity, & Inclusion
    • Finance & Operations
    • International
    • Leadership & Governance
    • Teaching & Learning
    • Scholarship & Research
    • Student Success
    • Technology
    • Transitions
    • The Workplace
  • Magazine
    • Current Issue
    • Special Issues
    • Podcast: College Matters from The Chronicle
  • Newsletters
  • Virtual Events
  • Ask Chron
  • Store
    • Featured Products
    • Reports
    • Data
    • Collections
    • Back Issues
  • Jobs
    • Find a Job
    • Post a Job
    • Professional Development
    • Career Resources
    • Virtual Career Fair
    Upcoming Events:
    An AI-Driven Work Force
    AI and Microcredentials
Sign In
Newsletter Icon

The Review

Understand the big ideas and provocative arguments shaping the academy. Delivered on Mondays. To read this newsletter as soon as it sends, sign up to receive it in your email inbox.

December 4, 2023
Share
  • Twitter
  • LinkedIn
  • Facebook
  • Email

From: Len Gutkin

Subject: The Review: Course evaluations are garbage science.

In a recent essay in our pages, the Cornell psychologists Wendy M. Williams and Stephen J. Ceci review evidence about sexism in the academic sciences and find that, in most areas — hiring and promotion, grants, and salary — there’s much less of it than is often supposed. But they note one exception: student evaluations. “

To continue reading for FREE, please sign in.

Sign In

Or subscribe now to read with unlimited access for as low as $10/month.

Don’t have an account? Sign up now.

A free account provides you access to a limited number of free articles each month, plus newsletters, job postings, salary data, and exclusive store discounts.

Sign Up

In a recent essay in our pages, the Cornell psychologists Wendy M. Williams and Stephen J. Ceci review evidence about sexism in the academic sciences and find that, in most areas — hiring and promotion, grants, and salary — there’s much less of it than is often supposed. But they note one exception: students’ teaching evaluations. “The fact that teaching ratings are sexist,” they write, “is valuable information, suggesting that the use of these ratings should be carefully considered.”

Williams and Ceci’s meta-analysis of “a very large number of studies across all academic fields” provides further quantitative grounding for what everyone already knows: Teaching evaluations are a mess. As David Delgado Shorter has discussed, also in our pages, the evidence that teaching evaluations reflect racial and gender bias on the part of students dates back over 40 years. Even more damning, “good” student evaluations may be negatively correlated with academic achievement. According to Bill Harbaugh, an economist at the University of Oregon who has studied the matter, students enrolled in classes taught by professors with high student ratings actually learn less.

The most comprehensive recent analysis of the situation is Wolfgang Stroebe’s widely cited 2020 article in Basic and Applied Social Psychology, whose title says it all: “Student Evaluations of Teaching Encourages Poor Teaching and Contributes to Grade Inflation.” Teaching evaluations, Stroebel concludes, fail to measure actual learning, illegitimately reward teacher attractiveness, penalize minorities and women, and trigger cascading grade inflation. And because “there is evidence that faculty members in precarious positions (e.g., young tenure-track faculty) will be particularly motivated to improve the ratings they receive for their course by grading leniently,” teaching evalutations corrupt the classroom at its root. As a junior faculty member said to me earlier this month, “I’ve arrived at the point of the semester where I consider giving everyone a big grade boost on their last paper to juice my pre-tenure-review evals.”

Despite their well-documented failings, such evaluations are now almost ubiquitous: 94 percent of colleges collected course evaluations in 2010, compared to just 29 percent in 1973. Why? I don’t pretend to know, but Jordan J. Titus, an emeritus professor of sociology at the University of Alaska at Fairbanks, has as good an answer as any I’ve seen: “The intellectual work of faculty is being replaced by a new obligation to be service providers to consumers.” That’s from “Student Ratings in a Consumerist Academy: Leveraging Pedagogic Control and Authority,” a 2008 article in Sociological Perspectives. The ubiquity of evaluations is part of a larger process whereby “academic control and professional authority are transferred from faculty to students.” And to administrators, one might add. As “student entitlement” increases, so too does the pressure on administrators to satisfy student demands. From this point of view, evaluations are a kind of disciplinary tool, a stick management uses to make sure the faculty satisfies the customers.

When the concept of student evaluations was first developed in the 1920s, by the psychologists Herman H. Remmers, at Purdue University, and Edwin R. Guthrie, at the University of Washington, administrators were never meant to have access to them. Remmers and Guthrie saw evaluations as modest tools for pedagogical improvement, not criteria of administrative judgment. In the 1950s, Guthrie warned about the misuse of evaluations. But no one listened. Instead, as Stroebe writes, they “soon became valued sources of information for university administrators, who used them as a basis for decisions about merit increases and promotion.” Is it too late to return to Remmers and Guthrie’s original conception?

The Latest

Photo illustration of a chapter beginning using the first paragraphs from the story below.
The Review | Essay
How Chapters Shaped the History of Reading
By Catherine Gallagher November 27, 2023
Nicholas Dames’s new book considers a literary feature that scholars usually neglect.
cover of Agrippa book, medieval magic and mysticism
The Review | Essay
The Line Between Knowledge and Magic Is Thinner Than We Think
By Colin Dickey November 28, 2023
Anthony Grafton’s alternate history of the Renaissance.
Illustration of a woman holding back a large pencil eraser. Around her are other pencils with erasers, and below her are words that cause editors concern.
The Review | Essay
Slouching Toward Sensitivity
By Janet Burroway November 28, 2023
Content warning: This essay contains obscenities, slurs, sex, bullying, child abuse, alcoholism, pregnancy, addiction, murder, suicide, religion, culture, opinions, politics, language, and academe.
traditional illustration in blue and red of a woman in a lab holding a beaker
The Review | Essay
How Sexist Is Science?
By Wendy M. Williams, Stephen J. Ceci November 30, 2023
The findings are more complicated than is often reported.

Recommended

  • “A certain kind of individualism, one more spiritual than political, was his alternative to the complacency he diagnosed in both secular and religious institutions.” In The Nation, Clare Carlisle writes about Kierkegaard, by way of Bruce H. Kirmmse’s new translation of The Sickness Unto Death.
  • “As with so many things in the postwar period, the 1960s radicals painted the target, and the 1980s neoliberals fired the killer shot.” In The Critic, Philip Pilkington recounts the shuttering of psychiatric asylums.
  • “The inability to commit to something outside oneself is often punctuated by spasms of fanatical commitment.” In Commonweal, Alex Stern reviews three new books that look to “the religious and philosophical traditions of the past” in search of “the resources to mitigate atomism and alienation.”
  • “Film — fiction or documentary — should not concern itself with the facts of ordinary existence, which are the province of the journalist, the bureaucrat, and the accountant.” In the London Review of Books, David Trotter on Werner Herzog.

Write to me at len.gutkin@chronicle.com.

Yours,

Len Gutkin

ADVERTISEMENT
ADVERTISEMENT

More News

Photo illustration showing Santa Ono seated, places small in the corner of a dark space
'Unrelentingly Sad'
Santa Ono Wanted a Presidency. He Became a Pariah.
Illustration of a rushing crowd carrying HSI letters
Seeking precedent
Funding for Hispanic-Serving Institutions Is Discriminatory and Unconstitutional, Lawsuit Argues
Photo-based illustration of scissors cutting through paper that is a photo of an idyllic liberal arts college campus on one side and money on the other
Finance
Small Colleges Are Banding Together Against a Higher Endowment Tax. This Is Why.
Pano Kanelos, founding president of the U. of Austin.
Q&A
One Year In, What Has ‘the Anti-Harvard’ University Accomplished?

From The Review

Photo- and type-based illustration depicting the acronym AAUP with the second A as the arrow of a compass and facing not north but southeast.
The Review | Essay
The Unraveling of the AAUP
By Matthew W. Finkin
Photo-based illustration of the Capitol building dome propped on a stick attached to a string, like a trap.
The Review | Opinion
Colleges Can’t Trust the Federal Government. What Now?
By Brian Rosenberg
Illustration of an unequal sign in black on a white background
The Review | Essay
What Is Replacing DEI? Racism.
By Richard Amesbury

Upcoming Events

Plain_Acuity_DurableSkills_VF.png
Why Employers Value ‘Durable’ Skills
Warwick_Leadership_Javi.png
University Transformation: a Global Leadership Perspective
  • Explore Content
    • Latest News
    • Newsletters
    • Letters
    • Free Reports and Guides
    • Professional Development
    • Virtual Events
    • Chronicle Store
    • Chronicle Intelligence
    • Jobs in Higher Education
    • Post a Job
  • Know The Chronicle
    • About Us
    • Vision, Mission, Values
    • DEI at The Chronicle
    • Write for Us
    • Work at The Chronicle
    • Our Reporting Process
    • Advertise With Us
    • Brand Studio
    • Accessibility Statement
  • Account and Access
    • Manage Your Account
    • Manage Newsletters
    • Individual Subscriptions
    • Group and Institutional Access
    • Subscription & Account FAQ
  • Get Support
    • Contact Us
    • Reprints & Permissions
    • User Agreement
    • Terms and Conditions
    • Privacy Policy
    • California Privacy Policy
    • Do Not Sell My Personal Information
1255 23rd Street, N.W. Washington, D.C. 20037
© 2025 The Chronicle of Higher Education
The Chronicle of Higher Education is academe’s most trusted resource for independent journalism, career development, and forward-looking intelligence. Our readers lead, teach, learn, and innovate with insights from The Chronicle.
Follow Us
  • twitter
  • instagram
  • youtube
  • facebook
  • linkedin