Skip to content
ADVERTISEMENT
Sign In
  • Sections
    • News
    • Advice
    • The Review
  • Topics
    • Data
    • Diversity, Equity, & Inclusion
    • Finance & Operations
    • International
    • Leadership & Governance
    • Teaching & Learning
    • Scholarship & Research
    • Student Success
    • Technology
    • Transitions
    • The Workplace
  • Magazine
    • Current Issue
    • Special Issues
    • Podcast: College Matters from The Chronicle
  • Newsletters
  • Events
    • Virtual Events
    • Chronicle On-The-Road
    • Professional Development
  • Ask Chron
  • Store
    • Featured Products
    • Reports
    • Data
    • Collections
    • Back Issues
  • Jobs
    • Find a Job
    • Post a Job
    • Professional Development
    • Career Resources
    • Virtual Career Fair
  • More
  • Sections
    • News
    • Advice
    • The Review
  • Topics
    • Data
    • Diversity, Equity, & Inclusion
    • Finance & Operations
    • International
    • Leadership & Governance
    • Teaching & Learning
    • Scholarship & Research
    • Student Success
    • Technology
    • Transitions
    • The Workplace
  • Magazine
    • Current Issue
    • Special Issues
    • Podcast: College Matters from The Chronicle
  • Newsletters
  • Events
    • Virtual Events
    • Chronicle On-The-Road
    • Professional Development
  • Ask Chron
  • Store
    • Featured Products
    • Reports
    • Data
    • Collections
    • Back Issues
  • Jobs
    • Find a Job
    • Post a Job
    • Professional Development
    • Career Resources
    • Virtual Career Fair
    Upcoming Events:
    College Advising
    Serving Higher Ed
    Chronicle Festival 2025
Sign In
Wired Campus circle logo

Wired Campus

The latest on tech and education.

Completion Rates Aren’t the Best Way to Judge MOOCs, Researchers Say

By Steve Kolowich January 21, 2014

When it comes to measuring the success of an education program, the bottom line is often the completion rate. How many students are finishing their studies and walking away with a credential?

To continue reading for FREE, please sign in.

Sign In

Or subscribe now to read with unlimited access for as low as $10/month.

Don’t have an account? Sign up now.

A free account provides you access to a limited number of free articles each month, plus newsletters, job postings, salary data, and exclusive store discounts.

Sign Up

When it comes to measuring the success of an education program, the bottom line is often the completion rate. How many students are finishing their studies and walking away with a credential?

But that is not the right way to judge massive open online courses, according to researchers at Harvard University and the Massachusetts Institute of Technology. “Course certification rates are misleading and counterproductive indicators of the impact and potential of open online courses,” write the researchers in the first of a series of working papers on MOOCs offered by the two universities. (The Harvard papers can be found here, the MIT papers here.)

Released on Tuesday, the papers make good on a pledge by Harvard and MIT in 2012, when the universities teamed up to create edX, a nonprofit provider of massive open online courses. At the time, the presidents of the two universities said their foray into online instruction would include a major research project aimed at learning more about online courses, especially the kind that they and other exclusive universities had started making available free.

ADVERTISEMENT

The papers released on Tuesday draw on data from 17 MOOCs offered by Harvard and MIT in 2012 and 2013. A number of academics have begun studying aspects of the MOOC phenomenon, but few academic papers have been published so far.

The first of the working papers, which was written jointly by researchers at both universities, provides an overview of the data from those 17 MOOCs. Some findings:

  • 841,687 people registered for the 17 MOOCs from Harvard and MIT.
  • 5 percent of all registrants earned a certificate of completion.
  • 35 percent never viewed any of the course materials.
  • 54 percent of those who “explored” at least half of the course content earned a certificate of completion.
  • 66 percent of all registrants already held a bachelor’s degree or higher.
  • 74 percent of those who earned a certificate of completion held a bachelor’s degree or higher.
  • 29 percent of all registrants were female.
  • 3 percent of all registrants were from underdeveloped countries.

Some of these findings reinforce what others have already observed about MOOCs: Few of those who sign up for a course end up completing it. Most MOOC students already hold traditional degrees. Students who sign up for MOOCs are overwhelmingly male.

But looking at percentages such as the ones listed above is a bad way to try to understand MOOCs, the researchers told The Chronicle in an interview.

Completion rates make sense as a metric for assessing conventional college courses, said Andrew Dean Ho, an associate professor in Harvard’s Graduate School of Education and director of the university’s MOOC research. In a conventional course, the goals are generally consistent and well understood: Students want to complete the course and, eventually, earn a credential. The instructors want the same thing.

ADVERTISEMENT

A MOOC is more of a blank canvas, said Mr. Ho. Some students who register for MOOCs have no intention of completing, and some instructors do not emphasize completion as a priority. Success and failure take many forms.

“It’s reaching a completely different set of students, with different intentions, perhaps, and different ways of seeing the instructors and the content of the course,” said Isaac Chuang, a professor of physics, electrical engineering, and computer science at MIT.

In future studies, the researchers hope to classify registrants according to their reasons for taking a MOOC, “so we can judge the impact of these courses in terms of what students expected to get out of them,” Mr. Ho said.

In the meantime, the Harvard and MIT researchers said they hoped the new studies would help people understand that technology and scale are not the only things that distinguish MOOCs from other kinds of higher education.

“People are projecting their own desires onto MOOCs,” said Mr. Ho, “and then holding them accountable for criteria that the instructors and institutions and, most importantly, students don’t hold for themselves.”

Correction (1/22/2014, 10:58 a.m.): Because of a technological error, this article originally showed the wrong byline, Jennifer Howard’s. It has been corrected; the writer is Steve Kolowich.

We welcome your thoughts and questions about this article. Please email the editors or submit a letter for publication.
Share
  • Twitter
  • LinkedIn
  • Facebook
  • Email
About the Author
Steve Kolowich
Steve Kolowich was a senior reporter for The Chronicle of Higher Education. He wrote about extraordinary people in ordinary times, and ordinary people in extraordinary times.
ADVERTISEMENT
ADVERTISEMENT

More News

Protesters attend a demonstration in support of Palestinian activist Mahmoud Khalil, March 10, 2025, in New York.
First-Amendment Rights
Noncitizen Professors Testify About Chilling Effect of Others’ Detentions
Photo-based illustration of a rock preciously suspended by a rope over three beakers.
Broken Promise
U.S. Policy Made America’s Research Engine the Envy of the World. One President Could End That.
lab-costs-promo.jpg
Research Expenses
What Does It Cost to Run a Lab?
Research illustration Microscope
Dreams Deferred
How Trump’s Cuts to Science Funding Are Derailing Young Scholars’ Careers

From The Review

University of Virginia President Jim Ryan keeps his emotions in check during a news conference, Monday, Nov. 14, 2022 in Charlottesville. Va. Authorities say three people have been killed and two others were wounded in a shooting at the University of Virginia and a student is in custody. (AP Photo/Steve Helber)
The Review | Opinion
Jim Ryan’s Resignation Is a Warning
By Robert Zaretsky
Photo-based illustration depicting a close-up image of a mouth of a young woman with the letter A over the lips and grades in the background
The Review | Opinion
When Students Want You to Change Their Grades
By James K. Beggan
Photo-based illustration of a student and a professor, each occupying a red circle in a landscape of scribbles.
The Review | Opinion
Meet Students Where They Are? Maybe Not.
By Mark Horowitz

Upcoming Events

Chronfest25_Virtual-Events_Page_862x574.png
Chronicle Festival: Innovation Amid Uncertainty
07-16-Advising-InsideTrack - forum assets v1_Plain.png
The Evolving Work of College Advising
Lead With Insight
  • Explore Content
    • Latest News
    • Newsletters
    • Letters
    • Free Reports and Guides
    • Professional Development
    • Events
    • Chronicle Store
    • Chronicle Intelligence
    • Jobs in Higher Education
    • Post a Job
  • Know The Chronicle
    • About Us
    • Vision, Mission, Values
    • DEI at The Chronicle
    • Write for Us
    • Work at The Chronicle
    • Our Reporting Process
    • Advertise With Us
    • Brand Studio
    • Accessibility Statement
  • Account and Access
    • Manage Your Account
    • Manage Newsletters
    • Individual Subscriptions
    • Group and Institutional Access
    • Subscription & Account FAQ
  • Get Support
    • Contact Us
    • Reprints & Permissions
    • User Agreement
    • Terms and Conditions
    • Privacy Policy
    • California Privacy Policy
    • Do Not Sell My Personal Information
1255 23rd Street, N.W. Washington, D.C. 20037
© 2025 The Chronicle of Higher Education
The Chronicle of Higher Education is academe’s most trusted resource for independent journalism, career development, and forward-looking intelligence. Our readers lead, teach, learn, and innovate with insights from The Chronicle.
Follow Us
  • twitter
  • instagram
  • youtube
  • facebook
  • linkedin