Skip to content
ADVERTISEMENT
Sign In
  • Sections
    • News
    • Advice
    • The Review
  • Topics
    • Data
    • Diversity, Equity, & Inclusion
    • Finance & Operations
    • International
    • Leadership & Governance
    • Teaching & Learning
    • Scholarship & Research
    • Student Success
    • Technology
    • Transitions
    • The Workplace
  • Magazine
    • Current Issue
    • Special Issues
    • Podcast: College Matters from The Chronicle
  • Newsletters
  • Events
    • Virtual Events
    • Chronicle On-The-Road
    • Professional Development
  • Ask Chron
  • Store
    • Featured Products
    • Reports
    • Data
    • Collections
    • Back Issues
  • Jobs
    • Find a Job
    • Post a Job
    • Professional Development
    • Career Resources
    • Virtual Career Fair
  • More
  • Sections
    • News
    • Advice
    • The Review
  • Topics
    • Data
    • Diversity, Equity, & Inclusion
    • Finance & Operations
    • International
    • Leadership & Governance
    • Teaching & Learning
    • Scholarship & Research
    • Student Success
    • Technology
    • Transitions
    • The Workplace
  • Magazine
    • Current Issue
    • Special Issues
    • Podcast: College Matters from The Chronicle
  • Newsletters
  • Events
    • Virtual Events
    • Chronicle On-The-Road
    • Professional Development
  • Ask Chron
  • Store
    • Featured Products
    • Reports
    • Data
    • Collections
    • Back Issues
  • Jobs
    • Find a Job
    • Post a Job
    • Professional Development
    • Career Resources
    • Virtual Career Fair
    Upcoming Events:
    College Advising
    Serving Higher Ed
    Chronicle Festival 2025
Sign In
Academic Workplace

Can Data Measure Faculty Productivity? Rutgers Professors Say No

By Ellen Wexler December 11, 2015

After submitting a records request, David M. Hughes received an Excel spreadsheet summing up his productivity as a scholar.

The numbers seemed straightforward: He had written three articles, won two awards, and published two books. He had received no grant money. And that, according to context provided on the spreadsheet, put him above the national average for publishing and awards.

To continue reading for FREE, please sign in.

Sign In

Or subscribe now to read with unlimited access for as low as $10/month.

Don’t have an account? Sign up now.

A free account provides you access to a limited number of free articles each month, plus newsletters, job postings, salary data, and exclusive store discounts.

Sign Up

After submitting a records request, David M. Hughes received an Excel spreadsheet summing up his productivity as a scholar.

The numbers seemed straightforward: He had written three articles, won two awards, and published two books. He had received no grant money. And that, according to context provided on the spreadsheet, put him above the national average for publishing and awards.

But Mr. Hughes, president of the Rutgers University faculty union, knows that his data were flawed. In the time periods measured, he had written only one article and received one award. He had also received a $37,500 grant.

“They are undercutting my reputation in some ways and actually inflating my reputation in other ways,” he said. “It’s all intellectually dishonest.”

The data come from Academic Analytics, a company that measures scholarly productivity. It adds up professors’ journal articles, citations, books, research grants, and awards, and compares those numbers with national benchmarks. At the moment, the database includes more than 270,000 faculty members.

Academic Analytics tracks David Hughes’s books, articles, citations, and grants, and compares them with national benchmarks. This graph, which he received through an open-records request, shows Mr. Hughes’s percentile rankings.
Academic Analytics tracks David Hughes’s books, articles, citations, and grants, and compares them with national benchmarks. This graph, which he received through an open-records request, shows Mr. Hughes’s percentile rankings.

Rutgers bought a license for the service in 2013. And on Monday the School of Arts and Sciences faculty will vote on a resolution calling for the university to limit how it uses the data. On Wednesday union leaders will meet with the university’s academic and labor-relations team to discuss the issue.

“The way scholarship aids public discourse is by being innovative, being interdisciplinary, taking risks,” Mr. Hughes said. “Academic Analytics doesn’t measure or value those kinds of unconventional forms of research and publishing.”

Faculty-union leaders are wary of how the database will affect their profession. They’re worried that professors will feel obligated to produce work that’s reflected in their scores, and that the university will use flawed data to make decisions.

The resolution calls on the School of Arts and Sciences to promise not to consider the company’s data in tenure, promotion, or resource allocation. It also demands that the data be distributed to faculty members, who would be able to check the accuracy of the information and see how they compare to professors in their discipline across the country.

E.J. Miranda, a university spokesman, declined to comment on the matter, saying only that “if a resolution is forwarded, we will review it.” Academic Analytics also declined to comment.

ADVERTISEMENT

Some deans have said informally that the database won’t be used for tenure or promotion. “It is a misconception to believe in or be worried about such use,” Robert Goodman, executive director of the Rutgers New Jersey Agricultural Experiment Station and executive dean of the Rutgers School of Environmental and Biological Sciences, wrote in an email to the faculty.

But Mr. Hughes wants an agreement in writing. According to the license agreement between the university and Academic Analytics, Rutgers is paying $492,500 for the database over four years. For that price, Mr. Hughes said, Rutgers must be taking the data seriously.

Under the union’s collective-bargaining agreement, faculty members already have access to most of the material in their personnel files. Most professors aren’t privy to what’s in the database, however, and Mr. Hughes thinks that’s a violation of the agreement.

‘We have a right to know what is said about us, and therefore what the administration believes about us.’

He said it’s like knowing your credit score: When you’re buying a home, you need to know your credit score to see how you’ll fare in the market. As a faculty member, you need to be able to see how you’re judged and how you’ve done so far.

ADVERTISEMENT

“We have a right to know what is said about us, and therefore what the administration believes about us,” he said.

Mr. Hughes got access to his data through a public-records request. But when he received the material, the date ranges weren’t included. Did the data reflect two years of work, or 20? Without knowing the dates, Mr. Hughes couldn’t tell whether the numbers were accurate.

He asked a dean to grant him access to the password-protected database, where he found the dates. He said most of his data were incorrect.

When Yolanda Martínez-San Miguel, a professor of Latino and Hispanic Caribbean studies and comparative literature at Rutgers, viewed her data through her department chair, she made the same discovery. According to the database, she had published one book and two articles. In reality, she had published four books and 30 articles.

ADVERTISEMENT

“I cannot go and correct their records,” Ms. Martínez-San Miguel said. “There’s no way I can actually tell them, ‘You’re missing three books and 28 articles.’”

Ms. Martínez-San Miguel does “what many people would consider nontraditional scholarship,” and she thinks that’s why the database missed so much of her work: It was published in smaller, nontraditional outlets. If the university continues to use the database, she worries that smaller disciplines will suffer.

“We’re putting aside not only quality but the fact that there are emerging fields, interdisciplinary knowledge, people like me who want to take risks,” she said. “Diversity of knowledge is curtailed.”

Mr. Hughes said the database could tempt professors to “game the system": They may choose to submit only to well-known American journals, rather than to, say, a smaller Puerto Rican journal read by many in their discipline. They may focus less on other aspects of their work — like teaching and service — that aren’t represented in the data.

“If I’m a chair, and I know that my department rating will generate a greater chance of a new faculty line or a new seminar series,” he said, “I would be crazy not to tell my faculty to do the things that count.”

We welcome your thoughts and questions about this article. Please email the editors or submit a letter for publication.
Share
  • Twitter
  • LinkedIn
  • Facebook
  • Email
ADVERTISEMENT
ADVERTISEMENT

More News

Vector illustration of large open scissors  with several workers in seats dangling by white lines
Iced Out
Duke Administrators Accused of Bypassing Shared-Governance Process in Offering Buyouts
Illustration showing money being funnelled into the top of a microscope.
'A New Era'
Higher-Ed Associations Pitch an Alternative to Trump’s Cap on Research Funding
Illustration showing classical columns of various heights, each turning into a stack of coins
Endowment funds
The Nation’s Wealthiest Small Colleges Just Won a Big Tax Exemption
WASHINGTON, DISTICT OF COLUMBIA, UNITED STATES - 2025/04/14: A Pro-Palestinian demonstrator holding a sign with Release Mahmud Khalil written on it, stands in front of the ICE building while joining in a protest. Pro-Palestinian demonstrators rally in front of the ICE building, demanding freedom for Mahmoud Khalil and all those targeted for speaking out against genocide in Palestine. Protesters demand an end to U.S. complicity and solidarity with the resistance in Gaza. (Photo by Probal Rashid/LightRocket via Getty Images)
Campus Activism
An Anonymous Group’s List of Purported Critics of Israel Helped Steer a U.S. Crackdown on Student Activists

From The Review

John T. Scopes as he stood before the judges stand and was sentenced, July 2025.
The Review | Essay
100 Years Ago, the Scopes Monkey Trial Discovered Academic Freedom
By John K. Wilson
Vector illustration of a suited man with a pair of scissors for a tie and an American flag button on his lapel.
The Review | Opinion
A Damaging Endowment Tax Crosses the Finish Line
By Phillip Levine
University of Virginia President Jim Ryan keeps his emotions in check during a news conference, Monday, Nov. 14, 2022 in Charlottesville. Va. Authorities say three people have been killed and two others were wounded in a shooting at the University of Virginia and a student is in custody. (AP Photo/Steve Helber)
The Review | Opinion
Jim Ryan’s Resignation Is a Warning
By Robert Zaretsky

Upcoming Events

07-31-Turbulent-Workday_assets v2_Plain.png
Keeping Your Institution Moving Forward in Turbulent Times
Ascendium_Housing_Plain.png
What It Really Takes to Serve Students’ Basic Needs: Housing
Lead With Insight
  • Explore Content
    • Latest News
    • Newsletters
    • Letters
    • Free Reports and Guides
    • Professional Development
    • Events
    • Chronicle Store
    • Chronicle Intelligence
    • Jobs in Higher Education
    • Post a Job
  • Know The Chronicle
    • About Us
    • Vision, Mission, Values
    • DEI at The Chronicle
    • Write for Us
    • Work at The Chronicle
    • Our Reporting Process
    • Advertise With Us
    • Brand Studio
    • Accessibility Statement
  • Account and Access
    • Manage Your Account
    • Manage Newsletters
    • Individual Subscriptions
    • Group and Institutional Access
    • Subscription & Account FAQ
  • Get Support
    • Contact Us
    • Reprints & Permissions
    • User Agreement
    • Terms and Conditions
    • Privacy Policy
    • California Privacy Policy
    • Do Not Sell My Personal Information
1255 23rd Street, N.W. Washington, D.C. 20037
© 2025 The Chronicle of Higher Education
The Chronicle of Higher Education is academe’s most trusted resource for independent journalism, career development, and forward-looking intelligence. Our readers lead, teach, learn, and innovate with insights from The Chronicle.
Follow Us
  • twitter
  • instagram
  • youtube
  • facebook
  • linkedin