Skip to content
ADVERTISEMENT
Sign In
  • Sections
    • News
    • Advice
    • The Review
  • Topics
    • Data
    • Diversity, Equity, & Inclusion
    • Finance & Operations
    • International
    • Leadership & Governance
    • Teaching & Learning
    • Scholarship & Research
    • Student Success
    • Technology
    • Transitions
    • The Workplace
  • Magazine
    • Current Issue
    • Special Issues
    • Podcast: College Matters from The Chronicle
  • Newsletters
  • Virtual Events
  • Ask Chron
  • Store
    • Featured Products
    • Reports
    • Data
    • Collections
    • Back Issues
  • Jobs
    • Find a Job
    • Post a Job
    • Professional Development
    • Career Resources
    • Virtual Career Fair
  • More
  • Sections
    • News
    • Advice
    • The Review
  • Topics
    • Data
    • Diversity, Equity, & Inclusion
    • Finance & Operations
    • International
    • Leadership & Governance
    • Teaching & Learning
    • Scholarship & Research
    • Student Success
    • Technology
    • Transitions
    • The Workplace
  • Magazine
    • Current Issue
    • Special Issues
    • Podcast: College Matters from The Chronicle
  • Newsletters
  • Virtual Events
  • Ask Chron
  • Store
    • Featured Products
    • Reports
    • Data
    • Collections
    • Back Issues
  • Jobs
    • Find a Job
    • Post a Job
    • Professional Development
    • Career Resources
    • Virtual Career Fair
    Upcoming Events:
    An AI-Driven Work Force
    University Transformation: a Global Leadership Perspective
Sign In
Research

NIH Presses Journals to Focus on Reproducibility of Studies

By Paul Basken June 6, 2014

A group of leading medical-journal editors, convened by the National Institutes of Health, this week endorsed a set of guidelines intended to tackle the widespread problem of scientific findings that cannot be replicated.

About 40 editors, representing journals that include Science and Nature, reached a “general agreement” about what they must accept as their responsibility for ensuring the reproducibility of their published findings, the NIH director, Francis S. Collins, said on Thursday.

To continue reading for FREE, please sign in.

Sign In

Or subscribe now to read with unlimited access for as low as $10/month.

Don’t have an account? Sign up now.

A free account provides you access to a limited number of free articles each month, plus newsletters, job postings, salary data, and exclusive store discounts.

Sign Up

A group of leading medical-journal editors, convened by the National Institutes of Health, this week endorsed a set of guidelines intended to tackle the widespread problem of scientific findings that cannot be replicated.

About 40 editors, representing journals that include Science and Nature, reached a “general agreement” about what they must accept as their responsibility for ensuring the reproducibility of their published findings, the NIH director, Francis S. Collins, said on Thursday.

Dr. Collins, addressing a semiannual session of his advisory committee at the agency’s headquarters, in Bethesda, Md., gave only limited details of the agreement, and the NIH did not release a copy of the text. Officials at Science declined to authorize a release, saying the principles were still regarded as a draft.

As one element, however, Dr. Collins said the journals discussed the need to publish articles that identify reproducibility problems with studies they previously published.

If widely adopted across the industry, the changes would “substantially” aid the campaign to make published scientific findings more reliable, he said.

The problem of so-called irreproducibility in science has been festering for years. A landmark moment came in 2005, when John P.A. Ioannidis, a professor of medicine at Stanford University, published an analysis in PLOS Medicine concluding that most published research findings appeared to be substantially false.

Dr. Collins and his principal deputy director, Lawrence A. Tabak, wrote a commentary in Nature in January that cited a growing recognition “that the complex system for ensuring the reproducibility of biomedical research is failing and is in need of restructuring.”

More Steps Planned or Under Way

The meeting with journal editors was one of several actions under way at the NIH to improve the quality of the research the agency finances, as well as to improve equity in the process of carrying it out, Dr. Collins told the advisory panel.

The session with the journals will be followed next month by a similar meeting with representatives of the pharmaceutical industry, Dr. Collins said. NIH officials want to hear the industry’s advice for improving reproducibility in research, and to press the companies to be more transparent about scientific findings that are not publicly released because they did not achieve a desired result.

And within its own grant-application structure, the NIH is moving ahead with a new process designed to help scientists emphasize the quality, more than the quantity, of their past work. Under the new “biosketch” format, researchers will be permitted to describe up to five of their most significant contributions to science, the agency has said.

ADVERTISEMENT

The NIH began a second round of testing the approach with grant applicants last month. The changes, as well as the meeting with journal editors, are designed to counter the current atmosphere of competitiveness that too often has both scientists and journal editors hurrying to publish papers without taking enough time to ensure the work is as thorough and accurate as possible, Dr. Collins said.

The problem is particularly evident in testing with animals that produces evidence used to shape testing in human beings, with clear implications for both cost and safety, Dr. Collins said.

Failure to replicate a study’s findings, by itself, doesn’t mean the scientists did anything wrong, said one advisory-panel member, Harlan M. Krumholz, a professor of medicine at Yale University. But the prevalence of the problem suggests a cultural attitude that the NIH is uniquely positioned to help fix, Dr. Krumholz said.

Also on Thursday the NIH’s Advisory Committee to the Director presented Dr. Collins with a series of recommendations for pushing forward the agency’s campaign to achieve greater racial balance among its grant recipients. In addition, NIH officials described for the panel their continuing work—which will include tests over the coming year involving grant applications—to strengthen overall fairness and impartiality in the NIH’s grant-review process.

We welcome your thoughts and questions about this article. Please email the editors or submit a letter for publication.
Tags
Law & Policy Political Influence & Activism
Share
  • Twitter
  • LinkedIn
  • Facebook
  • Email
Paul Basken Bio
About the Author
Paul Basken
Paul Basken was a government policy and science reporter with The Chronicle of Higher Education, where he won an annual National Press Club award for exclusives.
ADVERTISEMENT
ADVERTISEMENT

More News

Illustration of a magnifying glass highlighting the phrase "including the requirements set forth in Presidential Executive Order 14168 titled Defending Women From Gender Ideology Extremism and Restoring Biological Truth to the Federal Government."
Policy 'Whiplash'
Research Grants Increasingly Require Compliance With Trump’s Orders. Here’s How Colleges Are Responding.
Photo illustration showing internal email text snippets over a photo of a University of Iowa campus quad
Red-state reticence
Facing Research Cuts, Officials at U. of Iowa Spoke of a ‘Limited Ability to Publicly Fight This’
Photo illustration showing Santa Ono seated, places small in the corner of a dark space
'Unrelentingly Sad'
Santa Ono Wanted a Presidency. He Became a Pariah.
Illustration of a rushing crowd carrying HSI letters
Seeking precedent
Funding for Hispanic-Serving Institutions Is Discriminatory and Unconstitutional, Lawsuit Argues

From The Review

Football game between UCLA and Colorado University, at Folsom Field in Boulder, Colo., Sept. 24, 2022.
The Review | Opinion
My University Values Football More Than Education
By Sigman Byrd
Photo- and type-based illustration depicting the acronym AAUP with the second A as the arrow of a compass and facing not north but southeast.
The Review | Essay
The Unraveling of the AAUP
By Matthew W. Finkin
Photo-based illustration of the Capitol building dome propped on a stick attached to a string, like a trap.
The Review | Opinion
Colleges Can’t Trust the Federal Government. What Now?
By Brian Rosenberg

Upcoming Events

Plain_Acuity_DurableSkills_VF.png
Why Employers Value ‘Durable’ Skills
Warwick_Leadership_Javi.png
University Transformation: a Global Leadership Perspective
Lead With Insight
  • Explore Content
    • Latest News
    • Newsletters
    • Letters
    • Free Reports and Guides
    • Professional Development
    • Virtual Events
    • Chronicle Store
    • Chronicle Intelligence
    • Jobs in Higher Education
    • Post a Job
  • Know The Chronicle
    • About Us
    • Vision, Mission, Values
    • DEI at The Chronicle
    • Write for Us
    • Work at The Chronicle
    • Our Reporting Process
    • Advertise With Us
    • Brand Studio
    • Accessibility Statement
  • Account and Access
    • Manage Your Account
    • Manage Newsletters
    • Individual Subscriptions
    • Group and Institutional Access
    • Subscription & Account FAQ
  • Get Support
    • Contact Us
    • Reprints & Permissions
    • User Agreement
    • Terms and Conditions
    • Privacy Policy
    • California Privacy Policy
    • Do Not Sell My Personal Information
1255 23rd Street, N.W. Washington, D.C. 20037
© 2025 The Chronicle of Higher Education
The Chronicle of Higher Education is academe’s most trusted resource for independent journalism, career development, and forward-looking intelligence. Our readers lead, teach, learn, and innovate with insights from The Chronicle.
Follow Us
  • twitter
  • instagram
  • youtube
  • facebook
  • linkedin