Skip to content
ADVERTISEMENT
Sign In
  • Sections
    • News
    • Advice
    • The Review
  • Topics
    • Data
    • Diversity, Equity, & Inclusion
    • Finance & Operations
    • International
    • Leadership & Governance
    • Teaching & Learning
    • Scholarship & Research
    • Student Success
    • Technology
    • Transitions
    • The Workplace
  • Magazine
    • Current Issue
    • Special Issues
    • Podcast: College Matters from The Chronicle
  • Newsletters
  • Virtual Events
  • Ask Chron
  • Store
    • Featured Products
    • Reports
    • Data
    • Collections
    • Back Issues
  • Jobs
    • Find a Job
    • Post a Job
    • Professional Development
    • Career Resources
    • Virtual Career Fair
  • More
  • Sections
    • News
    • Advice
    • The Review
  • Topics
    • Data
    • Diversity, Equity, & Inclusion
    • Finance & Operations
    • International
    • Leadership & Governance
    • Teaching & Learning
    • Scholarship & Research
    • Student Success
    • Technology
    • Transitions
    • The Workplace
  • Magazine
    • Current Issue
    • Special Issues
    • Podcast: College Matters from The Chronicle
  • Newsletters
  • Virtual Events
  • Ask Chron
  • Store
    • Featured Products
    • Reports
    • Data
    • Collections
    • Back Issues
  • Jobs
    • Find a Job
    • Post a Job
    • Professional Development
    • Career Resources
    • Virtual Career Fair
    Upcoming Events:
    An AI-Driven Work Force
    University Transformation
Sign In
News

Big Data for Student Success Still Limited to Early Adopters

By Lawrence Biemiller April 9, 2017
At the U. of Iowa, Sam Van Horne (seated) and his staff members run a big-data project that provides students and instructors  in certain courses with continually updated dashboards of information, including a forecast of the student’s final grade.
At the U. of Iowa, Sam Van Horne (seated) and his staff members run a big-data project that provides students and instructors in certain courses with continually updated dashboards of information, including a forecast of the student’s final grade.Jim Slosiarek For The Chronicle

At the University of Iowa, “General Chemistry I” enrolls as many as 1,500 students a semester. They can go to the lectures in person — 8 a.m. Tuesdays and Thursdays in a Chemistry Building auditorium that seats 395 — or watch recordings through the university’s course-management system. In addition to attending a weekly discussion section led by a teaching assistant, students are told to plan on spending six hours a week online doing homework using Mastering Chemistry, a textbook publisher’s product.

To continue reading for FREE, please sign in.

Sign In

Or subscribe now to read with unlimited access for as low as $10/month.

Don’t have an account? Sign up now.

A free account provides you access to a limited number of free articles each month, plus newsletters, job postings, salary data, and exclusive store discounts.

Sign Up

At the University of Iowa, “General Chemistry I” enrolls as many as 1,500 students a semester. They can go to the lectures in person — 8 a.m. Tuesdays and Thursdays in a Chemistry Building auditorium that seats 395 — or watch recordings through the university’s course-management system. In addition to attending a weekly discussion section led by a teaching assistant, students are told to plan on spending six hours a week online doing homework using Mastering Chemistry, a textbook publisher’s product.

The chemistry students are among the first students at Iowa to benefit from a home-grown predictive-analytics project that aims to help make sure they pass the course. The three-year-old project, called Elements of Success, combines data about students who have already taken the course with information about current students’ backgrounds, how long they’re spending on homework, and how well they’re understanding it. Then it offers each student a dashboard with visualizations that show how he or she is doing relative to others in the class, and also forecasts the student’s final grade. For students who aren’t doing well, it suggests what help is available from the Academic Support and Retention office.

Digital Campus cover with text
The Digital Campus: Big Data
Colleges want to track students and help them succeed, to find out what works in the classroom, and to measure professors’ productivity. Read a special report that unpacks what big data can and can’t do.
  • The Cost That Holds Back Ed-Tech Innovation
  • How Open E-Credentials Will Transform Higher Education
  • Big Data Alone Won’t Help Students
  • The Job-Market Moment of Digital Humanities
  • Big Hopes, Scant Evidence

For some years now, learning-technology visionaries have anticipated a time when analytical tools will harness streams of data about how students fare in courses, generating reliable predictive models that will help make sure they succeed in college. But so far comparatively few institutions have seen those visions become reality. Elsewhere, technical challenges, wariness among faculty and staff members, and commercial offerings that fail to satisfy mean that widespread adoption of learning analytics is yet to come.

Last year’s edition of the annual Campus Computing Survey found that less than a fifth of respondents rated data-analytics investments their institutions had made as “very effective.” Kenneth C. Green, the survey’s director, says that’s not a surprise. “As with so many new technologies in the consumer, corporate, and campus sectors, the actual, implied, and inferred promises often fall short of initial performance.”

Even Ithaka, a nonprofit organization devoted to helping colleges take advantage of digital resources, said in a comprehensive 2016 report that “the potential of these new uses remains underdeveloped,” although the report also said that “research using large-scale learner data is progressing along a number of promising avenues.”

Some large institutions have moved more enthusiastically to deploy campuswide early warning systems for students’ academic performance, among them Arizona State, Georgia State, and Purdue Universities, Rio Salado College, and the University of Michigan. And Unizin, a consortium aimed at “enhancing learner success with digital technology and resources,” has grown to a dozen institutional members, including Iowa. But Iowa’s more cautious approach is by no means unusual.

“General Chemistry I” is a “very large course, a very critical course,” says Sam Van Horne, assessment director in the university’s Office of Teaching, Learning & Technology. In university surveys, a third of first-year students rank the course as their most difficult, he adds, so “this was a class where we wanted to do more to support learners.” Mr. Van Horne worked with several others, including one of the course instructors, Russell Larsen, who wanted to offer students better feedback than was available through commercial products. Elements of Success is now also used in another chemistry course as well as in “Foundations of Biology,” and about 90 percent of students in the courses look at the dashboards, Mr. Van Horne says.

“We see a positive difference for users that are using it more frequently,” he says. It’s also cut down on the number of emails instructors get from students seeking to know how they’re doing. And it’s opened the eyes of some instructors who “believed that women or underrepresented students were doing as well as other students,” Mr. Van Horne says, because “we were able to show that they were not.”

Tammi J. Anderson, a first-year student in “General Chemistry I,” has found Elements of Success to be helpful. “It gives me an idea if I am at where I need to be, and if I’m not, it shows me how far off I am,” says Ms. Anderson, who plans to major in neurobiology and attend medical school.

But Elements of Success also represents some of the difficulties of using “big data” to help students succeed. Mr. Van Horne, a graduate student, and an undergraduate assistant manually pull data for the project from the university student-information system, the course-management system, and the homework site, although the university recently switched to a new course-management provider that will enable them to automate some of the work.

“That’s one of the critical roadblocks to learning analytics,” he says. “Data exists in different third-party systems.” To expand the program, “Either we find better ways to automate or we have to have more resources.”

ADVERTISEMENT

Elements of Success is customized for each course, relying on whatever information best predicts how students will fare on the first exam. For “General Chemistry,” that means looking at students’ performance on the most recent three homework assignments, but for “Foundations of Biology,” the program instead picks up the results of clicker-based quizzes. There’s also a different “dashboard” for every course. “We don’t want our dashboard to have 50 points of data — you have to distill it down. You want them to get feedback to orient them to take the next action.”

Pennsylvania State University hopes to roll out a data-driven early warning system this coming fall for its STEM-centered Millennium Scholars program, which enrolls a number of students from underrepresented minority groups. “We’re going at it slowly,” says David R. Smith, associate dean for advising and executive director of undergraduate studies.

“We could have all this data that says x, y, or z about students and their behaviors and their patterns, but have you really thought about what you want students to do once you’ve identified that there’s an issue?” he says. “You’ve got to have the resources lined up to help them. My real thing is, data is great, but it’s only as good as the people that are behind it.”

Mr. Smith is also concerned that data could be used to unfairly profile students.

ADVERTISEMENT

“I think there’s any number of issues with that,” he says. “Doors could get inadvertently closed on the student because you’re reinforcing biases that whoever’s talking to that student may have.

“Does this add to that? Does it detract from it? Can we use data to better understand interventions to know whether or not those interventions help students succeed?”

Meanwhile, many smaller colleges say they don’t see a need for data-driven early-alert systems, although they are taking advantage of the communications and note-sharing capacity offered by commercial advising systems. “We are too small to have big data,” says Kerry E. Pannell, vice president for academic affairs and dean of Agnes Scott College, which has just under 950 students. “We don’t have 10,000 students and an algorithm running to show if a student gets a C in this class. The advisers already know all the students.”

But Agnes Scott and other small colleges are using data to improve admissions and retention by understanding what kinds of students do well at their institutions, and how to attract and retain them. Franklin & Marshall College’s vice president for planning, Alan S. Caniglia, says that a review of admissions data a dozen years ago showed that “financial aid that was not based on need was not increasing the likelihood that the kinds of students we were trying to attract would actually enroll.” So the college dropped so-called merit aid, and is now getting more applications and better students. “If we hadn’t been analyzing the data and been open to what the data would tell us, we would never have gotten to that point.”

ADVERTISEMENT

And while many colleges are proceeding cautiously where learning analytics are concerned, there’s plenty of interest among faculty members, says Jennifer Sparrow, Penn State’s senior director of teaching and learning with technology.

Kyle Bowen, the university’s director of education-technology services, says faculty members in different departments are working on projects that would use textual-analysis programs, facial-recognition software, and even smartphones or Apple Watches to capture data about how students go about learning. Someday soon such information could be added to the early warning system the university will roll out for its Millennium Scholars next fall, and could even be even augmented with data captured when students swipe into dining halls, dormitories, and recreation facilities, giving the university an ever-more-detailed understanding of how students learn.

“Once you have this really good model to work from, you can begin to use this kind of science to explore engagement questions, course-design questions,” says Mr. Bowen. “The more we layer in additional data to our model, the more accurate it gets.”

A version of this article appeared in the April 14, 2017, issue.
Read other items in The Digital Campus: Big Data.
We welcome your thoughts and questions about this article. Please email the editors or submit a letter for publication.
Share
  • Twitter
  • LinkedIn
  • Facebook
  • Email
About the Author
Lawrence Biemiller
Lawrence Biemiller was a senior writer who began working at The Chronicle of Higher Education in 1980. He wrote about campus architecture, the arts, and small colleges, among many other topics.
ADVERTISEMENT
ADVERTISEMENT

Related Content

As Big-Data Companies Come to Teaching, a Pioneer Issues a Warning
As Big Data Comes to College, Officials Wrestle to Set New Ethical Norms
The Good News About Learning by the Numbers

More News

Mangan-Censorship-0610.jpg
Academic Freedom
‘A Banner Year for Censorship’: More States Are Restricting Classroom Discussions on Race and Gender
On the day of his retirement party, Bob Morse poses for a portrait in the Washington, D.C., offices of U.S. News and World Report in June 2025. Morse led the magazine's influential and controversial college rankings efforts since its inception in 1988. Michael Theis, The Chronicle.
List Legacy
‘U.S. News’ Rankings Guru, Soon to Retire, Reflects on the Role He’s Played in Higher Ed
Black and white photo of the Morrill Hall building on the University of Minnesota campus with red covering one side.
Finance & operations
U. of Minnesota Tries to Soften the Blow of Tuition Hikes, Budget Cuts With Faculty Benefits
Photo illustration showing a figurine of a football player with a large price tag on it.
Athletics
Loans, Fees, and TV Money: Where Colleges Are Finding the Funds to Pay Athletes

From The Review

A stack of coins falling over. Motion blur. Falling economy concept. Isolated on white.
The Review | Opinion
Will We Get a More Moderate Endowment Tax?
By Phillip Levine
Photo illustration of a classical column built of paper, with colored wires overtaking it like vines of ivy
The Review | Essay
The Latest Awful EdTech Buzzword: “Learnings”
By Kit Nicholls
William F. Buckley, Jr.
The Review | Interview
William F. Buckley Jr. and the Origins of the Battle Against ‘Woke’
By Evan Goldstein

Upcoming Events

Plain_Acuity_DurableSkills_VF.png
Why Employers Value ‘Durable’ Skills
Warwick_Leadership_Javi.png
University Transformation: A Global Leadership Perspective
Lead With Insight
  • Explore Content
    • Latest News
    • Newsletters
    • Letters
    • Free Reports and Guides
    • Professional Development
    • Virtual Events
    • Chronicle Store
    • Chronicle Intelligence
    • Jobs in Higher Education
    • Post a Job
  • Know The Chronicle
    • About Us
    • Vision, Mission, Values
    • DEI at The Chronicle
    • Write for Us
    • Work at The Chronicle
    • Our Reporting Process
    • Advertise With Us
    • Brand Studio
    • Accessibility Statement
  • Account and Access
    • Manage Your Account
    • Manage Newsletters
    • Individual Subscriptions
    • Group and Institutional Access
    • Subscription & Account FAQ
  • Get Support
    • Contact Us
    • Reprints & Permissions
    • User Agreement
    • Terms and Conditions
    • Privacy Policy
    • California Privacy Policy
    • Do Not Sell My Personal Information
1255 23rd Street, N.W. Washington, D.C. 20037
© 2025 The Chronicle of Higher Education
The Chronicle of Higher Education is academe’s most trusted resource for independent journalism, career development, and forward-looking intelligence. Our readers lead, teach, learn, and innovate with insights from The Chronicle.
Follow Us
  • twitter
  • instagram
  • youtube
  • facebook
  • linkedin