Skip to content
ADVERTISEMENT
Sign In
  • Sections
    • News
    • Advice
    • The Review
  • Topics
    • Data
    • Diversity, Equity, & Inclusion
    • Finance & Operations
    • International
    • Leadership & Governance
    • Teaching & Learning
    • Scholarship & Research
    • Student Success
    • Technology
    • Transitions
    • The Workplace
  • Magazine
    • Current Issue
    • Special Issues
    • Podcast: College Matters from The Chronicle
  • Newsletters
  • Events
    • Virtual Events
    • Chronicle On-The-Road
    • Professional Development
  • Ask Chron
  • Store
    • Featured Products
    • Reports
    • Data
    • Collections
    • Back Issues
  • Jobs
    • Find a Job
    • Post a Job
    • Professional Development
    • Career Resources
    • Virtual Career Fair
  • More
  • Sections
    • News
    • Advice
    • The Review
  • Topics
    • Data
    • Diversity, Equity, & Inclusion
    • Finance & Operations
    • International
    • Leadership & Governance
    • Teaching & Learning
    • Scholarship & Research
    • Student Success
    • Technology
    • Transitions
    • The Workplace
  • Magazine
    • Current Issue
    • Special Issues
    • Podcast: College Matters from The Chronicle
  • Newsletters
  • Events
    • Virtual Events
    • Chronicle On-The-Road
    • Professional Development
  • Ask Chron
  • Store
    • Featured Products
    • Reports
    • Data
    • Collections
    • Back Issues
  • Jobs
    • Find a Job
    • Post a Job
    • Professional Development
    • Career Resources
    • Virtual Career Fair
    Upcoming Events:
    College Advising
    Serving Higher Ed
    Chronicle Festival 2025
Sign In
News

Disease-Prevention Expert Helps Lead Center to Analyze How Science Goes Wrong

By Ben Wieder April 28, 2014
John P.A. Ioannidis
John P.A. IoannidisStanford U.

A new center at Stanford University seeks to encourage scientists to look to a new source for research material: the mirror.

At the Meta-Research Innovation Center at Stanford, or Metrics, John P.A. Ioannidis and Steven N. Goodman, both professors of medicine at Stanford, plan to study how research is done, and how it can be done better.

To continue reading for FREE, please sign in.

Sign In

Or subscribe now to read with unlimited access for as low as $10/month.

Don’t have an account? Sign up now.

A free account provides you access to a limited number of free articles each month, plus newsletters, job postings, salary data, and exclusive store discounts.

Sign Up

A new center at Stanford University seeks to encourage scientists to look to a new source for research material: the mirror.

At the Meta-Research Innovation Center at Stanford, or Metrics, John P.A. Ioannidis and Steven N. Goodman, both professors of medicine at Stanford, plan to study how research is done, and how it can be done better.

Dr. Ioannidis is perhaps best known outside epidemiology circles for a 2005 paper provocatively titled “Why Most Published Research Findings Are False.”

Small sample sizes and financial conflicts of interest were among several red flags that Dr. Ioannidis, then a professor of medicine at Greece’s University of Ioannina School of Medicine, highlighted as potential indicators of dubious findings.

As the Stanford center’s directors, he and Dr. Goodman hope to bring together like-minded researchers working across many disciplines to share their findings informally and, potentially, at conferences every couple of years. The program has received a $6-million grant from the Laura and John Arnold Foundation.

“We’re all interested in advancing excellence in research,” says Dr. Ioannidis, who is 48 and joined Stanford in 2010. Through their combined efforts he hopes the center’s researchers can improve the efficiency of scientific research by identifying common design errors and biases that can lead to flawed research that isn’t reproducible.

He cautions, though, that meta-researchers can be prone to the same mistakes as the researchers whose work they hope to improve.

Dr. Ioannidis, who plans to devote roughly half of his time to the center, says he was first drawn to the field of meta-analysis as he struggled with mistakes in his own work. As he turned to prior research for answers, he found that much of it suffered from the same problems.

“It became apparent to me that these issues occurred so frequently that, maybe instead of trying to answer a single question, one should take a bird’s-eye view,” he says. “What’s happening in the scientific literature in general?”

A meeting with meta-analysis pioneers Thomas C. Chalmers and Joseph Lau during Dr. Ioannidis’s residency at Harvard Medical School persuaded him to devote more of his research efforts to the still-young field.

ADVERTISEMENT

Identifying common flaws is one goal, but Dr. Ioannidis says it’s also important to decide how to fix them. Should a review of research methods occur before grants are issued? By institutional review boards, or at the pre-publication level?

Part of the answer is persuading researchers to share their data with others, so that their results can be reproduced. But many researchers are resistant to the idea, particularly if they’re working with a unique data set.

“They feel that their databases are personal gold mines,” he says.

Despite pockets of resistance, Dr. Ioannidis says, most researchers have been receptive to his work. By applying the same scrutiny to his own work and drawing conclusions about wide swaths of research, rather than particular papers, he says, he has avoided making enemies in the ivory tower.

“If I were to say, ‘That person’s study is miserable,’” he says, “I would probably start to get some death threats.”

We welcome your thoughts and questions about this article. Please email the editors or submit a letter for publication.
Tags
The Workplace
Share
  • Twitter
  • LinkedIn
  • Facebook
  • Email
ADVERTISEMENT
ADVERTISEMENT

More News

Vector illustration of large open scissors  with several workers in seats dangling by white lines
Iced Out
Duke Administrators Accused of Bypassing Shared-Governance Process in Offering Buyouts
Illustration showing money being funnelled into the top of a microscope.
'A New Era'
Higher-Ed Associations Pitch an Alternative to Trump’s Cap on Research Funding
Illustration showing classical columns of various heights, each turning into a stack of coins
Endowment funds
The Nation’s Wealthiest Small Colleges Just Won a Big Tax Exemption
WASHINGTON, DISTICT OF COLUMBIA, UNITED STATES - 2025/04/14: A Pro-Palestinian demonstrator holding a sign with Release Mahmud Khalil written on it, stands in front of the ICE building while joining in a protest. Pro-Palestinian demonstrators rally in front of the ICE building, demanding freedom for Mahmoud Khalil and all those targeted for speaking out against genocide in Palestine. Protesters demand an end to U.S. complicity and solidarity with the resistance in Gaza. (Photo by Probal Rashid/LightRocket via Getty Images)
Campus Activism
An Anonymous Group’s List of Purported Critics of Israel Helped Steer a U.S. Crackdown on Student Activists

From The Review

John T. Scopes as he stood before the judges stand and was sentenced, July 2025.
The Review | Essay
100 Years Ago, the Scopes Monkey Trial Discovered Academic Freedom
By John K. Wilson
Vector illustration of a suited man with a pair of scissors for a tie and an American flag button on his lapel.
The Review | Opinion
A Damaging Endowment Tax Crosses the Finish Line
By Phillip Levine
University of Virginia President Jim Ryan keeps his emotions in check during a news conference, Monday, Nov. 14, 2022 in Charlottesville. Va. Authorities say three people have been killed and two others were wounded in a shooting at the University of Virginia and a student is in custody. (AP Photo/Steve Helber)
The Review | Opinion
Jim Ryan’s Resignation Is a Warning
By Robert Zaretsky

Upcoming Events

07-31-Turbulent-Workday_assets v2_Plain.png
Keeping Your Institution Moving Forward in Turbulent Times
Ascendium_Housing_Plain.png
What It Really Takes to Serve Students’ Basic Needs: Housing
Lead With Insight
  • Explore Content
    • Latest News
    • Newsletters
    • Letters
    • Free Reports and Guides
    • Professional Development
    • Events
    • Chronicle Store
    • Chronicle Intelligence
    • Jobs in Higher Education
    • Post a Job
  • Know The Chronicle
    • About Us
    • Vision, Mission, Values
    • DEI at The Chronicle
    • Write for Us
    • Work at The Chronicle
    • Our Reporting Process
    • Advertise With Us
    • Brand Studio
    • Accessibility Statement
  • Account and Access
    • Manage Your Account
    • Manage Newsletters
    • Individual Subscriptions
    • Group and Institutional Access
    • Subscription & Account FAQ
  • Get Support
    • Contact Us
    • Reprints & Permissions
    • User Agreement
    • Terms and Conditions
    • Privacy Policy
    • California Privacy Policy
    • Do Not Sell My Personal Information
1255 23rd Street, N.W. Washington, D.C. 20037
© 2025 The Chronicle of Higher Education
The Chronicle of Higher Education is academe’s most trusted resource for independent journalism, career development, and forward-looking intelligence. Our readers lead, teach, learn, and innovate with insights from The Chronicle.
Follow Us
  • twitter
  • instagram
  • youtube
  • facebook
  • linkedin