Skip to content
ADVERTISEMENT
Sign In
  • Sections
    • News
    • Advice
    • The Review
  • Topics
    • Data
    • Diversity, Equity, & Inclusion
    • Finance & Operations
    • International
    • Leadership & Governance
    • Teaching & Learning
    • Scholarship & Research
    • Student Success
    • Technology
    • Transitions
    • The Workplace
  • Magazine
    • Current Issue
    • Special Issues
    • Podcast: College Matters from The Chronicle
  • Newsletters
  • Events
    • Virtual Events
    • Chronicle On-The-Road
    • Professional Development
  • Ask Chron
  • Store
    • Featured Products
    • Reports
    • Data
    • Collections
    • Back Issues
  • Jobs
    • Find a Job
    • Post a Job
    • Professional Development
    • Career Resources
    • Virtual Career Fair
  • More
  • Sections
    • News
    • Advice
    • The Review
  • Topics
    • Data
    • Diversity, Equity, & Inclusion
    • Finance & Operations
    • International
    • Leadership & Governance
    • Teaching & Learning
    • Scholarship & Research
    • Student Success
    • Technology
    • Transitions
    • The Workplace
  • Magazine
    • Current Issue
    • Special Issues
    • Podcast: College Matters from The Chronicle
  • Newsletters
  • Events
    • Virtual Events
    • Chronicle On-The-Road
    • Professional Development
  • Ask Chron
  • Store
    • Featured Products
    • Reports
    • Data
    • Collections
    • Back Issues
  • Jobs
    • Find a Job
    • Post a Job
    • Professional Development
    • Career Resources
    • Virtual Career Fair
    Upcoming Events:
    Student Housing
    Serving Higher Ed
    Chronicle Festival 2025
Sign In
Publishing

Researchers and Scientific Groups Make New Push Against Impact Factors

By Paul Basken May 16, 2013

More than 150 researchers and 75 scientific groups issued a declaration on Thursday against the widespread use of journal “impact factors,” blaming the practice for dangerous distortions in financing and hiring in science.

The impact factor “has a number of well-documented deficiencies as a tool for research assessment,” the scientists said in the letter, which had been in preparation since a conference led by publishers and grant-writing agencies last year in San Francisco.

To continue reading for FREE, please sign in.

Sign In

Or subscribe now to read with unlimited access for as low as $10/month.

Don’t have an account? Sign up now.

A free account provides you access to a limited number of free articles each month, plus newsletters, job postings, salary data, and exclusive store discounts.

Sign Up

More than 150 researchers and 75 scientific groups issued a declaration on Thursday against the widespread use of journal “impact factors,” blaming the practice for dangerous distortions in financing and hiring in science.

The impact factor “has a number of well-documented deficiencies as a tool for research assessment,” the scientists said in the letter, which had been in preparation since a conference led by publishers and grant-writing agencies last year in San Francisco.

Those deficiencies include the ability of publishers to manipulate the calculations, and the way the metrics encourage university hiring and promotion decisions, as well as grant agencies’ award distributions, that can lack an in-depth understanding of scientific work.

“There is certainly a need for fair and objective methods to evaluate science and scientists, no doubt about that,” said Stefano Bertuzzi, executive director of the American Society for Cell Biology, which organized the campaign. “But that need does not change the fact that the journal impact factor does not measure what it’s supposed to measure when it is applied to evaluations of scientists’ work.”

For all those who signed the letter, however, the effect may be overshadowed by those who did not, including some of the world’s leading publishers and representatives of leading research universities. They include the Nature Publishing Group and Elsevier, two of the most dominant scientific publishers, and the Association of American Universities, which represents top-ranked research institutions.

The editor in chief of Nature, Philip Campbell, said he and other editors of the company’s journals have regularly published editorials critical of excesses in the use of journal impact factors, especially in rating researchers.

“But the draft statement contained many specific elements, some of which were too sweeping for me or my colleagues to sign up to,” said Mr. Campbell. Among the 18 recommendations in the letter, journals were asked to “greatly reduce emphasis on the journal impact factor as a promotional tool.”

A spokesman for the AAU, Barry Toiv, said he had no comment on the matter.

Years of Criticism

The impact factor is a number, calculated annually for each scientific journal, that reflects the average number of times its articles have been cited by authors of other articles. Some journals have been accused of inflating their ratings through practices that include requiring authors to cite articles that have appeared previously in the journal.

The measure was first developed more than 50 years ago as a way to help librarians decide which subscriptions to maintain. The simple statistic made sense for that purpose, Mr. Bertuzzi said, but not for its now-common use by universities and grant-writing agencies in important hiring and financing decisions.

ADVERTISEMENT

Although Nature declined to sign the letter, another top-ranked journal, Science, backed the effort. In an editorial timed to the release of the so-called San Francisco Declaration, the editor in chief of Science, Bruce Alberts, said problems attributable to the overreliance on impact factors include scientists’ avoiding riskier research that’s less certain to command a wide audience.

A focus on impact factors also “wastes the time of scientists by overloading highly cited journals such as Science with inappropriate submissions from researchers who are desperate to gain points from their evaluators,” Mr. Alberts wrote.

The impact factor has nevertheless withstood years of criticism, and Mr. Bertuzzi acknowledged there are no simple solutions, given the financial pressures on universities, publishers, and grant-writing agencies.

Still, there may be some new signs that the criticism is having an effect. The National Cancer Institute, a division of the National Institutes of Health, plans this year to join the private Howard Hughes Medical Institute and a few universities in pressing grant applicants to broaden their descriptions of career accomplishments beyond the common list of journal publications.

ADVERTISEMENT

Under the cancer institute’s plan, scientists will be “asked to describe your five leading contributions to science as a way of helping a reviewer to evaluate your contributions rather than depending on where your name is positioned in a paper with 15 authors or 500 authors,” the director of the cancer institute, Harold E. Varmus, told the annual meeting last month of the American Association for Cancer Research.

Dr. Varmus said on Thursday that he fully backs the San Francisco Declaration. Agencies, he said, “need to change the culture of science, especially with respect to the way that scientists evaluate each other, moving away from simplistic metrics.”

We welcome your thoughts and questions about this article. Please email the editors or submit a letter for publication.
Tags
Law & Policy Political Influence & Activism
Share
  • Twitter
  • LinkedIn
  • Facebook
  • Email
Paul Basken Bio
About the Author
Paul Basken
Paul Basken was a government policy and science reporter with The Chronicle of Higher Education, where he won an annual National Press Club award for exclusives.
ADVERTISEMENT
ADVERTISEMENT

More News

Susie West and Dianne Davis-Keening, U of M Extension SuperShelf coordinators.
A 'Connector' Severed
Congress Cut a Federal Nutrition Program, Jeopardizing Campus Jobs and Community Services
PPP 10 FINAL promo.jpg
Bouncing Back?
For Once, Public Confidence in Higher Ed Has Increased
University of California, Berkeley chancellor Dr. Rich Lyons, testifies at a Congressional hearing on antisemitism, in Washington, D.C., U.S., on July 15, 2025. It is the latest in a series of House hearings on antisemitism at the university level, one that critics claim is a convenient way for Republicans to punish universities they consider too liberal or progressive, thereby undermining responses to hate speech and hate crimes. (Photo by Allison Bailey/NurPhoto via AP)
Another Congressional Hearing
3 College Presidents Went to Congress. Here’s What They Talked About.
Tufts University student from Turkey, Rumeysa Ozturk, who was arrested by immigration agents while walking along a street in a Boston suburb, talks to reporters on arriving back in Boston, Saturday, May 10, 2025, a day after she was released from a Louisiana immigration detention center on the orders of a federal judge. (AP Photo/Rodrique Ngowi)
Law & Policy
Homeland Security Agents Detail Run-Up to High-Profile Arrests of Pro-Palestinian Scholars

From The Review

Photo-based illustration with repeated images of a student walking, in the pattern of a graph trending down, then up.
The Review | Opinion
7 Ways Community Colleges Can Boost Enrollment
By Bob Levey
Illustration of an ocean tide shaped like Donald Trump about to wash away sandcastles shaped like a college campus.
The Review | Essay
Why Universities Are So Powerless in Their Fight Against Trump
By Jason Owen-Smith
Photo-based illustration of a closeup of a pencil meshed with a circuit bosrd
The Review | Essay
How Are Students Really Using AI?
By Derek O'Connell

Upcoming Events

07-31-Turbulent-Workday_assets v2_Plain.png
Keeping Your Institution Moving Forward in Turbulent Times
Ascendium_Housing_Plain.png
What It Really Takes to Serve Students’ Basic Needs: Housing
Lead With Insight
  • Explore Content
    • Latest News
    • Newsletters
    • Letters
    • Free Reports and Guides
    • Professional Development
    • Events
    • Chronicle Store
    • Chronicle Intelligence
    • Jobs in Higher Education
    • Post a Job
  • Know The Chronicle
    • About Us
    • Vision, Mission, Values
    • DEI at The Chronicle
    • Write for Us
    • Work at The Chronicle
    • Our Reporting Process
    • Advertise With Us
    • Brand Studio
    • Accessibility Statement
  • Account and Access
    • Manage Your Account
    • Manage Newsletters
    • Individual Subscriptions
    • Group and Institutional Access
    • Subscription & Account FAQ
  • Get Support
    • Contact Us
    • Reprints & Permissions
    • User Agreement
    • Terms and Conditions
    • Privacy Policy
    • California Privacy Policy
    • Do Not Sell My Personal Information
1255 23rd Street, N.W. Washington, D.C. 20037
© 2025 The Chronicle of Higher Education
The Chronicle of Higher Education is academe’s most trusted resource for independent journalism, career development, and forward-looking intelligence. Our readers lead, teach, learn, and innovate with insights from The Chronicle.
Follow Us
  • twitter
  • instagram
  • youtube
  • facebook
  • linkedin