Skip to content
ADVERTISEMENT
Sign In
  • Sections
    • News
    • Advice
    • The Review
  • Topics
    • Data
    • Diversity, Equity, & Inclusion
    • Finance & Operations
    • International
    • Leadership & Governance
    • Teaching & Learning
    • Scholarship & Research
    • Student Success
    • Technology
    • Transitions
    • The Workplace
  • Magazine
    • Current Issue
    • Special Issues
    • Podcast: College Matters from The Chronicle
  • Newsletters
  • Virtual Events
  • Ask Chron
  • Store
    • Featured Products
    • Reports
    • Data
    • Collections
    • Back Issues
  • Jobs
    • Find a Job
    • Post a Job
    • Professional Development
    • Career Resources
    • Virtual Career Fair
  • More
  • Sections
    • News
    • Advice
    • The Review
  • Topics
    • Data
    • Diversity, Equity, & Inclusion
    • Finance & Operations
    • International
    • Leadership & Governance
    • Teaching & Learning
    • Scholarship & Research
    • Student Success
    • Technology
    • Transitions
    • The Workplace
  • Magazine
    • Current Issue
    • Special Issues
    • Podcast: College Matters from The Chronicle
  • Newsletters
  • Virtual Events
  • Ask Chron
  • Store
    • Featured Products
    • Reports
    • Data
    • Collections
    • Back Issues
  • Jobs
    • Find a Job
    • Post a Job
    • Professional Development
    • Career Resources
    • Virtual Career Fair
    Upcoming Events:
    Hands-On Career Preparation
    An AI-Driven Work Force
    Alternative Pathways
Sign In
Commentary

Stop Looking at Rankings. Use Academe’s Own Measures Instead.

By Richard M. Freeland September 8, 2017
<em>Stop Looking at Rankings. Use Academe’s Own   Measures Instead</em> 1
Tim Cook for The Chronicle

As the higher-education community begins the new academic year, we also prepare for the latest round of college rankings from U.S. News & World Report. We can expect coverage on which colleges have risen and which have fallen, followed by the usual laments from institutions’ presidents about how meaningless these rankings really are. My own perspective as a former university president differs, as I believe the rankings play a useful, though imperfect, role in providing information.

To continue reading for FREE, please sign in.

Sign In

Or subscribe now to read with unlimited access for as low as $10/month.

Don’t have an account? Sign up now.

A free account provides you access to a limited number of free articles each month, plus newsletters, job postings, salary data, and exclusive store discounts.

Sign Up

<em>Stop Looking at Rankings. Use Academe’s Own   Measures Instead</em> 1
Tim Cook for The Chronicle

As the higher-education community begins the new academic year, we also prepare for the latest round of college rankings from U.S. News & World Report. We can expect coverage on which colleges have risen and which have fallen, followed by the usual laments from institutions’ presidents about how meaningless these rankings really are. My own perspective as a former university president differs, as I believe the rankings play a useful, though imperfect, role in providing information.

But the larger concern is why, after all these years of criticism from authoritative voices and significant progress on the part of academe in responding to external demands for more transparency, the U.S. News rankings continue to play such a powerful role in shaping public perceptions of institutional quality.

The best context for thinking about the rankings is the broad movement for more accountability in higher education, which dates from at least the 1980s and reached a kind of crescendo with the Spellings Commission report of 2006. The commercial success of U.S. News’s rankings was an early signal of a craving for information that would help prospective students and families make informed choices. Indeed, one of the reasons I have defended the rankings is that a significant percentage of the metrics — most notably graduation rates, faculty qualifications, and investment in academic programs — are legitimate indicators of academic quality. But I also welcomed them because I believed they would foster competition, which would lead to a better system for informing the public about institutional quality.

That prediction has more than been fulfilled. In recent years, many more commercial publications have entered the arena with their own ranking systems. The federal government has also gotten into the act with the College Scorecard to complement its well-established Ipeds, or Integrated Postsecondary Education Data System program. More important and potentially promising have been the many efforts from within higher education to create accountability systems that allow for comparisons among institutions along academically significant dimensions, without resorting to the kind of simplistic format needed to produce an overall ranking. Critics of the rankings are right to argue that assigning colleges and universities a unique number on a linear scale is a folly.

Among the most impressive of the newer accountability efforts is the Voluntary System of Accountability, sponsored in the wake of the Spellings Commission by the Association of Public and Land-Grant Universities and the American Association of State Colleges and Universities. On the private side, the National Association of Independent Colleges and Universities developed a University and College Accountability Network that includes profile data on the organization’s members, and the Council of Independent Colleges was an early and strong supporter of accountability efforts. Especially notable are a new generation of reports by state higher-education authorities providing data on each state’s public institutions, and, in the case of Illinois, private institutions as well.

These reports typically include graduation rates, net costs, scholarship possibilities, programs offered, and student diversity. Just 11 years after the Spellings report, higher education has come a long way in providing information about institutional performance to the public, though the effort remains very much a work in progress.

Why then, given all this progress, do the rankings, and especially the U.S. News rankings, continue to have so much influence over public opinion about colleges?

A part of the answer is the sheer marketing power of the magazine. In addition, the rankings tell readers something about institutional status, which remains an important, even decisive, consideration for many applicants who may confuse status with quality. A third factor is simplicity. The reports being produced from within higher education tend to be complex, overwhelming readers with information and requiring considerable work to compare institutional results. A final reason is that there continues to be deep resistance within academe to publishing data about what students actually learn.

This last point is especially troubling. According to an authoritative summary of the accountability movement, by the mid-1990s there was general agreement within higher education that providing information on learning outcomes needed to be a central component of any accountability system. Moreover, early iterations of the VSA included the requirement that participating colleges administer one of three widely available assessments of intellectual achievement: the College Learning Assessment, the Collegiate Assessment of Academic Proficiency or the Measure of Academic Proficiency and Performance. In the end, however, most participants backed away from this requirement or decided not to publish results. There was too much resistance (especially from faculty members) to standardized testing, combined with legitimate questions about how much results on a single test could convey about student learning at particular institutions.

ADVERTISEMENT

While many colleges have developed programs to assess student learning (often because of accreditation requirements), few systematically collect and even fewer publish quantitative data that allow readers to compare student intellectual achievement across institutional lines. Until this gap is filled, higher education’s systems of accountability will continue to be data-rich but information-poor with respect to the quality of actual learning. The public will be left to rely on commercial rankings as indicators of institutional quality

Higher education has come a long way in providing information about institutional performance to the public, though the effort remains very much a work in progress.

The most hopeful sign that academe will find a way to measure and report student learning is a project sponsored by the Association of American Colleges and Universities and the State Higher Education Executive Officers Association that seeks to evaluate student learning based on assessments of student work using trained readers to score that work from selected courses at participating institutions. This approach is attractive to faculty members because it eschews standardized tests and provides information that is helpful in guiding curricular improvements. Twelve states and 75 two-year and four-year colleges are testing this approach to determine its validity in evaluating critical thinking, written communication, and quantitative reasoning. Results are encouraging.

If this assessment method continues to hold up, it will allow both the public and policy makers to easily understand measures of student achievement at the state level and ultimately at the institutional level against national and statewide benchmarks. It will also provide college leaders and faculty members with information about their own institutions. All who care about the reputation and quality of higher education, and who would like to replace commercial rankings with a more valid system of measuring institutional quality, will benefit from this effort.

Richard M. Freeland is president emeritus of Northeastern University and a higher-education consultant.

A version of this article appeared in the September 22, 2017, issue.
We welcome your thoughts and questions about this article. Please email the editors or submit a letter for publication.
Tags
Opinion
Share
  • Twitter
  • LinkedIn
  • Facebook
  • Email
ADVERTISEMENT
ADVERTISEMENT

Related Content

The Next Great Hope for Measuring Learning
Where the College Scorecard Has Gained Traction So Far — and Where It Hasn’t

More News

Graphic vector illustration of a ship with education-like embellishments being tossed on a black sea with a Kraken-esque elephant trunk ascending from the depth against a stormy red background.
Creeping concerns
Most Colleges Aren’t a Target of Trump (Yet). Here’s How Their Presidents Are Leading.
Photo-based illustration of calendars on a wall (July, August and September) with a red line marking through most of the dates
'A Creative Solution'
Facing Federal Uncertainty, Swarthmore Makes a Novel Plan: the 3-Month Budget
Marva Johnson is set to take the helm of Florida A&amp;M University this summer.
Leadership & governance
‘Surprising': A DeSantis-Backed Lobbyist Is Tapped to Lead Florida A&M
Students and community members protest outside of Coffman Memorial Union at the University of Minnesota in Minneapolis, on Tuesday, April 23, 2024.
Campus Activism
One Year After the Encampments, Campuses Are Quieter and Quicker to Stop Protests

From The Review

Glenn Loury in Providence, R.I. on May 7, 2024.
The Review | Conversation
Glenn Loury on the ‘Barbarians at the Gates’
By Evan Goldstein, Len Gutkin
Illustration showing a valedictorian speaker who's tassel is a vintage microphone
The Review | Opinion
A Graduation Speaker Gets Canceled
By Corey Robin
Illustration showing a stack of coins and a university building falling over
The Review | Opinion
Here’s What Congress’s Endowment-Tax Plan Might Cost Your College
By Phillip Levine

Upcoming Events

Ascendium_06-10-25_Plain.png
Views on College and Alternative Pathways
Coursera_06-17-25_Plain.png
AI and Microcredentials
  • Explore Content
    • Latest News
    • Newsletters
    • Letters
    • Free Reports and Guides
    • Professional Development
    • Virtual Events
    • Chronicle Store
    • Chronicle Intelligence
    • Jobs in Higher Education
    • Post a Job
  • Know The Chronicle
    • About Us
    • Vision, Mission, Values
    • DEI at The Chronicle
    • Write for Us
    • Work at The Chronicle
    • Our Reporting Process
    • Advertise With Us
    • Brand Studio
    • Accessibility Statement
  • Account and Access
    • Manage Your Account
    • Manage Newsletters
    • Individual Subscriptions
    • Group and Institutional Access
    • Subscription & Account FAQ
  • Get Support
    • Contact Us
    • Reprints & Permissions
    • User Agreement
    • Terms and Conditions
    • Privacy Policy
    • California Privacy Policy
    • Do Not Sell My Personal Information
1255 23rd Street, N.W. Washington, D.C. 20037
© 2025 The Chronicle of Higher Education
The Chronicle of Higher Education is academe’s most trusted resource for independent journalism, career development, and forward-looking intelligence. Our readers lead, teach, learn, and innovate with insights from The Chronicle.
Follow Us
  • twitter
  • instagram
  • youtube
  • facebook
  • linkedin