Skip to content
ADVERTISEMENT
Sign In
  • Sections
    • News
    • Advice
    • The Review
  • Topics
    • Data
    • Diversity, Equity, & Inclusion
    • Finance & Operations
    • International
    • Leadership & Governance
    • Teaching & Learning
    • Scholarship & Research
    • Student Success
    • Technology
    • Transitions
    • The Workplace
  • Magazine
    • Current Issue
    • Special Issues
    • Podcast: College Matters from The Chronicle
  • Newsletters
  • Virtual Events
  • Ask Chron
  • Store
    • Featured Products
    • Reports
    • Data
    • Collections
    • Back Issues
  • Jobs
    • Find a Job
    • Post a Job
    • Professional Development
    • Career Resources
    • Virtual Career Fair
  • More
  • Sections
    • News
    • Advice
    • The Review
  • Topics
    • Data
    • Diversity, Equity, & Inclusion
    • Finance & Operations
    • International
    • Leadership & Governance
    • Teaching & Learning
    • Scholarship & Research
    • Student Success
    • Technology
    • Transitions
    • The Workplace
  • Magazine
    • Current Issue
    • Special Issues
    • Podcast: College Matters from The Chronicle
  • Newsletters
  • Virtual Events
  • Ask Chron
  • Store
    • Featured Products
    • Reports
    • Data
    • Collections
    • Back Issues
  • Jobs
    • Find a Job
    • Post a Job
    • Professional Development
    • Career Resources
    • Virtual Career Fair
    Upcoming Events:
    A Culture of Cybersecurity
    Opportunities in the Hard Sciences
    Career Preparation
Sign In
News

Presidents Are Divided on Best Ways to Measure Quality

By David Glenn May 15, 2011

In a year when public concern about the cost and purpose of college education is rising, a new survey has revealed an undercurrent of anxiety among college presidents about the quality of teaching and learning on their campuses.

More than a quarter of the presidents in the Pew Research Center survey, done in association with The Chronicle, said they worried that their faculty members were grading too leniently. More than half said students spent less time studying than they did a decade ago. And when asked how the public should assess a college’s quality, the presidents did not show much faith in the student-engagement surveys and student-learning examinations that have come to prominence in the last decade. Instead, the yardsticks that got the most support were measures whose reliability is often questioned: graduation rates and accreditation.

To continue reading for FREE, please sign in.

Sign In

Or subscribe now to read with unlimited access for as low as $10/month.

Don’t have an account? Sign up now.

A free account provides you access to a limited number of free articles each month, plus newsletters, job postings, salary data, and exclusive store discounts.

Sign Up

In a year when public concern about the cost and purpose of college education is rising, a new survey has revealed an undercurrent of anxiety among college presidents about the quality of teaching and learning on their campuses.

More than a quarter of the presidents in the Pew Research Center survey, done in association with The Chronicle, said they worried that their faculty members were grading too leniently. More than half said students spent less time studying than they did a decade ago. And when asked how the public should assess a college’s quality, the presidents did not show much faith in the student-engagement surveys and student-learning examinations that have come to prominence in the last decade. Instead, the yardsticks that got the most support were measures whose reliability is often questioned: graduation rates and accreditation.

“It’s surprising to me how relatively low the numbers were for any kind of assessment measures or surveys of engagement as effective gauges of college quality,” said David C. Paris, executive director of the New Leadership Alliance for Student Learning and Accountability. Only 17 percent of presidents surveyed regarded those tools as “very effective.”

“Presidents clearly don’t think there are surveys or tests out there that really get them to effective assessment,” said Mr. Paris, whose organization has recruited 76 presidents to sign public pledges to improve learning on their campuses. “In some ways, that’s a depressing finding. We still have a long way to go as an industry in getting to the point of saying, This is what quality is, and here’s how we’ll know it.”

Barbara Couture, president of New Mexico State University, agrees with Mr. Paris that higher education needs to develop universally understood measures of quality. But she believes those measures should have more to do with labor-market outcomes than with direct tests of learning. “The measure I didn’t see on the survey, which is one I think we’re all being asked to respond to, was, How well are students being prepared to enter the workplace?” she said.

Ms. Couture believes that as states develop more-sophisticated longitudinal-data systems, the public will demand to see reports about the average salaries and unemployment rates of people who majored in a particular field at a particular college. But she cautioned that such reports would need to be interpreted carefully, taking into account the characteristics of the students who attend each institution.

“What we’re proud of here is that we take in students who are low-income, first-generation college students,” Ms. Couture said.

Other college leaders are not so enthusiastic about using the labor market as a bellwether of college quality. David W. Oxtoby, president of Pomona College, said the public discourse about job preparation had become toxic. “There’s this idea that the purpose of college is to train you for that first job, and anything else is just sort of extra, a waste of money,” he said. Narrow vocationalism, he fears, will erode colleges’ traditional missions of civic preparation and scientific inquiry.

But if Mr. Oxtoby dislikes Ms. Couture’s vision of labor-market measures, he is equally skeptical of Mr. Paris’s desire for better public yardsticks of learning. Mr. Oxtoby is not an admirer of the National Survey of Student Engagement or the Collegiate Learning Assessment, and he was pleased to see that such measures were not strongly endorsed in the survey.

“The fact that presidents are all over the board in terms of different ways to assess quality—to me, that’s just a reflection of reality,” Mr. Oxtoby said. “There’s not a single measure. There are many different measures.

ADVERTISEMENT

“I think this whole set of answers just shows that we don’t have good indicators for the public,” he continued. “I don’t think any of them by themselves are very valid. Nor is there going to be some magic bullet down the road if we just work harder.”

The Land of the Easy A

If presidents have mixed emotions about external measures of learning, they are also uneasy about their campuses’ primary internal measures: grades. Twenty-seven percent of presidents surveyed said they believed their faculty members graded too leniently.

“I do fall on that side of worrying about leniency,” said Douglas C. Bennett, president of Earlham College. “Every grading system we’ve had for the last 150 years winds up suffering from inflation, and the only way we ever fix that is to throw out the grading system and introduce a new one. You have to throw away the currency and issue entirely new currency.”

So what can presidents do to accelerate that process? Mr. Oxtoby said that presidents can set a tone, but that combating grade inflation really needs to be the work of faculty leaders. Pomona’s faculty recently clarified what is meant by A, B, C, and D grades, with the aim of making C’s and D’s seem less radioactive to students.

ADVERTISEMENT

“We want to provide some standards and encourage instructors to use a broader range of grades,” Mr. Oxtoby said. “Because grading, of course, becomes much less useful if everyone is getting an A.”

Presidents’ concern about lenient grading did not vary by their institutions’ selectivity, but it did vary by institutional type. Thirty-three percent of presidents of four-year private institutions said they worried about grading, but only 24 percent of those at four-year public colleges said they did.

The poster child for that theme might be E. Gordon Gee, president of Ohio State University. Mr. Gee said he was pleased with the grading standards at Ohio State. “Our faculty are very responsible about grading,” he said. “Our deans and our department chairs look pretty closely at those patterns.”

But when Mr. Gee was previously a president of private institutions, he said, grade inflation was a persistent concern. “At Vanderbilt and Brown, we had to work very hard on that problem. We used to laugh about the fact that 90 percent of our students were in the top 10 percent, which meant that our grading procedures were significantly skewed.”

ADVERTISEMENT

The public-private discrepancy should be no surprise, Pomona’s Mr. Oxtoby said. The intimacy of the smaller classes at many private colleges, he said, makes professors wince at giving C’s. “At a public university, if you’ve got a class of 200, it’s just a name on a piece of paper, whereas here, you know the particular student. You think, ‘How could I possibly give a low grade and hurt this student’s future chances?’”

Students Lounge?

Fifty-two percent of presidents said they believed students were studying less than their counterparts did a decade ago. (Interestingly, the presidents who were least likely to say that were those who had been in office for 11 years or more.)

Mr. Bennett, of Earlham, said those numbers should be interpreted cautiously. At his own institution, and at similar liberal-arts colleges, he said, students are being asked to do more demanding and sophisticated assignments than they were a decade ago. “When you ask students, How much are you reading? How much are you writing?, there’s quite a spread across institutions,” he said.

Eileen B. Wilson-Oyelaran, president of Kalamazoo College, said she believed that the survey reflected a healthy level of ferment among college leaders about the improvement of college learning. “There’s a lot of debate out there,” she said. “Each institution needs to find a way of communicating its learning outcomes, and there are lots of complex conversations about what those things might be. It’s not as if institutions are running away from the responsibility.”

We welcome your thoughts and questions about this article. Please email the editors or submit a letter for publication.
Share
  • Twitter
  • LinkedIn
  • Facebook
  • Email
About the Author
David Glenn
David Glenn joined The Chronicle of Higher Education in 2002. His work explored how faculty members are trained, encouraged, and evaluated as teachers; how college courses and curricula are developed; and the institutional incentives that sometimes discourage faculty members from investing their energy in teaching.
ADVERTISEMENT
ADVERTISEMENT

Related Content

Higher Education in America: a Crisis of Confidence
It’s More Than Just the Degree, Graduates Say
Most Presidents Favor No Tenure for Majority of Faculty
College Presidents Are Too Complacent
Higher Education in 2011

More News

Harvard University
'Deeply Unsettling'
Harvard’s Battle With Trump Escalates as Research Money Is Suddenly Canceled
Photo-based illustration of a hand and a magnifying glass focusing on a scene from Western Carolina Universiy
Equal Opportunity
The Trump Administration Widens Its Scrutiny of Colleges, With Help From the Internet
Santa J. Ono, president of the University of Michigan, watches a basketball game on the campus in November 2022.
'He Is a Chameleon'
At U. of Michigan, Frustrations Grew Over a President Who Couldn’t Be Pinned Down
Photo-based illustration of University of Michigan's president Jeremy Santa Ono emerging from a red shape of Florida
Leadership
A Major College-President Transition Is Defined by an About-Face on DEI

From The Review

Illustration showing a valedictorian speaker who's tassel is a vintage microphone
The Review | Opinion
A Graduation Speaker Gets Canceled
By Corey Robin
Illustration showing a stack of coins and a university building falling over
The Review | Opinion
Here’s What Congress’s Endowment-Tax Plan Might Cost Your College
By Phillip Levine
Photo-based illustration of a college building under an upside down baby crib
The Review | Opinion
Colleges Must Stop Infantilizing Everyone
By Gregory Conti

Upcoming Events

Ascendium_06-10-25_Plain.png
Views on College and Alternative Pathways
Coursera_06-17-25_Plain.png
AI and Microcredentials
  • Explore Content
    • Latest News
    • Newsletters
    • Letters
    • Free Reports and Guides
    • Professional Development
    • Virtual Events
    • Chronicle Store
    • Chronicle Intelligence
    • Jobs in Higher Education
    • Post a Job
  • Know The Chronicle
    • About Us
    • Vision, Mission, Values
    • DEI at The Chronicle
    • Write for Us
    • Work at The Chronicle
    • Our Reporting Process
    • Advertise With Us
    • Brand Studio
    • Accessibility Statement
  • Account and Access
    • Manage Your Account
    • Manage Newsletters
    • Individual Subscriptions
    • Group and Institutional Access
    • Subscription & Account FAQ
  • Get Support
    • Contact Us
    • Reprints & Permissions
    • User Agreement
    • Terms and Conditions
    • Privacy Policy
    • California Privacy Policy
    • Do Not Sell My Personal Information
1255 23rd Street, N.W. Washington, D.C. 20037
© 2025 The Chronicle of Higher Education
The Chronicle of Higher Education is academe’s most trusted resource for independent journalism, career development, and forward-looking intelligence. Our readers lead, teach, learn, and innovate with insights from The Chronicle.
Follow Us
  • twitter
  • instagram
  • youtube
  • facebook
  • linkedin