Skip to content
ADVERTISEMENT
Sign In
  • Sections
    • News
    • Advice
    • The Review
  • Topics
    • Data
    • Diversity, Equity, & Inclusion
    • Finance & Operations
    • International
    • Leadership & Governance
    • Teaching & Learning
    • Scholarship & Research
    • Student Success
    • Technology
    • Transitions
    • The Workplace
  • Magazine
    • Current Issue
    • Special Issues
    • Podcast: College Matters from The Chronicle
  • Newsletters
  • Virtual Events
  • Ask Chron
  • Store
    • Featured Products
    • Reports
    • Data
    • Collections
    • Back Issues
  • Jobs
    • Find a Job
    • Post a Job
    • Professional Development
    • Career Resources
    • Virtual Career Fair
  • More
  • Sections
    • News
    • Advice
    • The Review
  • Topics
    • Data
    • Diversity, Equity, & Inclusion
    • Finance & Operations
    • International
    • Leadership & Governance
    • Teaching & Learning
    • Scholarship & Research
    • Student Success
    • Technology
    • Transitions
    • The Workplace
  • Magazine
    • Current Issue
    • Special Issues
    • Podcast: College Matters from The Chronicle
  • Newsletters
  • Virtual Events
  • Ask Chron
  • Store
    • Featured Products
    • Reports
    • Data
    • Collections
    • Back Issues
  • Jobs
    • Find a Job
    • Post a Job
    • Professional Development
    • Career Resources
    • Virtual Career Fair
    Upcoming Events:
    An AI-Driven Work Force
    University Transformation
Sign In
Newsletter Icon

Teaching

Find insights to improve teaching and learning across your campus. Delivered on Thursdays. To read this newsletter as soon as it sends, sign up to receive it in your email inbox.

March 30, 2023
Share
  • Twitter
  • LinkedIn
  • Facebook
  • Email

From: Beth McMurtrie

Subject: Teaching: What You Can Learn From Students About ChatGPT

This week I:

  • Share two examples of how students can get involved in AI research and policymaking.
  • Ask for your thoughts about AI and disability.

What Do Students Think of ChatGPT?

Like a lot of you, I have been wondering how students are reacting to the rapid launch of generative AI tools. And I wanted to point you to creative ways in which professors and teaching experts have helped involve them in research and policymaking.

To continue reading for FREE, please sign in.

Sign In

Or subscribe now to read with unlimited access for as low as $10/month.

Don’t have an account? Sign up now.

A free account provides you access to a limited number of free articles each month, plus newsletters, job postings, salary data, and exclusive store discounts.

Sign Up

This week I:

  • Share two examples of how students can get involved in AI research and policymaking.
  • Ask for your thoughts about AI and disability.

What Do Students Think of ChatGPT?

Like a lot of you, I have been wondering how students are reacting to the rapid launch of generative AI tools. And I wanted to point you to creative ways in which professors and teaching experts have helped involve them in research and policymaking.

At Kalamazoo College, Autumn Hostetter, a psychology professor, and six of her students surveyed faculty members and students to determine whether they could detect an AI-written essay, and what they thought of the ethics of using various AI tools in writing. You can read their research paper here.

The group gathered three writing samples from students, and one generated by ChatGPT after asking for a 200-word essay responding to the following prompt: “Think about how your personality affects your study habits. Specifically, does being high or low on a particular personality dimension affect how likely you are to engage in active recall when you are studying? Be sure to explain these concepts and provide examples from your life.”

They generated several essays from ChatGPT and chose the one they thought was the best, noting that a student attempting to present the work as their own would likely do the same.

Participants were not told in advance that one essay was AI-generated, but instead were asked to evaluate how well each addressed the prompt. They also rated the writing samples on several dimensions of quality, such as grammar and personal experience, with the AI-generated version often coming out in the middle.

Afterwards they were told that one essay had been written by AI and asked which one they believed it to be. Most students and professors weren’t particularly confident of their guesses, and only 29 percent guessed correctly. One thing that helped improve someone’s detection ability? Having used ChatGPT more frequently.

Cassie Linnertz, a senior and one of the paper’s authors, said she was not surprised by these results. She knew how adept ChatGPT was at mimicking human writing. And a friend who took the survey immediately recognized some common habits — like using “overall” in the summary paragraph — and correctly guessed the AI-written essay. Linnertz’s takeaway: “Professors are going to have to be much more vigilant,” she said, and make sure that what students are producing in class, through writing or discussion, is aligned with what they produce in take-home writing assignments.

Next, participants were asked about a range of scenarios, such as using Grammarly, using AI to make an outline for a paper, using AI to write a section of a paper, looking up a concept on Google and copying it directly into a paper, and using AI to write an entire paper. As expected, commonly used tools like Grammarly were considered the most ethical, while writing a paper entirely with AI was considered the least. But researchers found variation in how people approached the in-between scenarios. Perhaps most interesting: Students and faculty members shared very similar views with each scenario.

MiaFlora Tucci, a senior and another of the authors, said the results suggest that students and professors are likely to find common ground around ethical use of AI, and that involving students in discussions about its ethical uses could be helpful.

There were several scenarios, for example, where both groups saw it more as a tool than a threat. Tucci said that reflects her own experience. In her physical organic chemistry class, for example, she had difficulty understanding a concept described in her textbook. So she copied the paragraph into ChatGPT, asked for a simpler explanation, and once that was clear to her, she confirmed the explanation was accurate using Google. If she had just used Google, she said, she probably would have spent a long time reading through academic papers looking for another explanation of the concept because it was so technical.

***

A second case involving students and AI is taking place at College Unbound, a small institution focused on adult learners. Lance Eaton, director of digital pedagogy, created and facilitated two consecutive, eight-week courses running this spring, in which students design and then road test an AI-generative tools policy for the college. (You can read his post outlining the process here.)

“We want students to be as prepared as possible, so they need to be part of that conversation,” he said. “We see our students as fully capable adults who are really enmeshed in complex dynamics in their lives.”

Veronica Machado enrolled in both of the courses. Machado, who works full-time while attending college, is intrigued by the potential of AI tools in her work, which focuses on students who need behavioral and academic support. So she dove into the first course with enthusiasm, spending a lot of time testing out functions.

She and her classmates then got together to discuss what they had learned, and began hammering out a policy that would support responsible use of AI technology.

The draft policy, which provides guidelines for both students and faculty members, states that if students use these tools in their work, they must make clear what portion was generated by the AI tool and which tool they used. Students are also responsible for any negative outcomes from using the tools, such as submitting biased or inaccurate information. “In general,” the policy states, “the ideas and central components of the work should be essentially the work of the student.”

The policy notes that each professor has the right to set their own classroom-usage expectations, which may differ from these guidelines. Faculty, too, must denote if they use AI-generated coursework, and are asked to “keep a relational balance between what they ask of students in terms of how much AI-generative content can show up in student work and in their own work.” In other words, if a professor decides that no more than 25 percent of a student’s work can be generated by AI, then that should hold true for their coursework as well. They are also not allowed to put students’ work into an AI tool to solicit feedback without their consent.

This term, Machado and her classmates are testing how well the guidelines work in practice. While they are going to try to determine how easy it is to distinguish AI content, said Machado, they do not want to make the conversation about stopping students from cheating. “We have to get away from that thought process,” she said. “We want people to connect with this new era of AI.”

Are you involving students in discussions around AI usage on your campus? Write to me at beth.mcmurtrie@chronicle.com and your example may appear in a future newsletter.

AI and Disability

As instructors think about redesigning elements of their courses to address ChatGPT and other text generators, the question of how this will affect students with disabilities often comes up. In-class assessments, including oral assessments, may present problems for some students, for example. But AI tools could also be a helpful study aid. As one viewer in a recent webinar wrote: “My son has dyslexia. He uses AI as a tool to help organize his thoughts and research into cohesive writing. He says it ‘has changed his life.’”

I’d like to dive deeper into the impact of generative AI on students with disabilities. If you have thoughts on the topic, write to me at beth.mcmurtrie@chronicle.com.

Thanks for reading Teaching. If you have suggestions or ideas, please feel free to email us at beckie.supiano@chronicle.com or beth.mcmurtrie@chronicle.com.

— Beth

Learn more about our Teaching newsletter, including how to contact us, at the Teaching newsletter archive page.

Tags
Teaching & Learning
ADVERTISEMENT
ADVERTISEMENT

More News

Black and white photo of the Morrill Hall building on the University of Minnesota campus with red covering one side.
Finance & operations
U. of Minnesota Tries to Soften the Blow of Tuition Hikes, Budget Cuts With Faculty Benefits
Photo illustration showing a figurine of a football player with a large price tag on it.
Athletics
Loans, Fees, and TV Money: Where Colleges Are Finding the Funds to Pay Athletes
Photo illustration of a donation jar turned on it's side, with coins spilling out.
Access & Affordability
Congressional Republicans Want to End Grad PLUS Loans. How Might It Affect Your Campus?
Florida Commissioner of Education Manny Diaz, Jr. delivers remarks during the State Board of Education meeting at Winter Park High School, Wednesday, March 27, 2024.
Executive Privilege
In Florida, University Presidents’ Pay Goes Up. Is Politics to Blame?

From The Review

Photo-based illustration of a tentacle holding a microscope
The Review | Essay
In Defense of ‘Silly’ Science
By Carly Anne York
Illustration showing a graduate's hand holding a college diploma and another hand but a vote into a ballot box
The Review | Essay
Civics Education Is Back. It Shouldn’t Belong to Conservatives.
By Timothy Messer-Kruse
Photo-based illustration of a hedges shaped like dollar signs in various degrees of having been over-trimmed by a shadowed Donald Trump figure carrying hedge trimmers.
The Review | Essay
What Will Be Left of Higher Ed in Four Years?
By Brendan Cantwell

Upcoming Events

Plain_Acuity_DurableSkills_VF.png
Why Employers Value ‘Durable’ Skills
Warwick_Leadership_Javi.png
University Transformation: A Global Leadership Perspective
Lead With Insight
  • Explore Content
    • Latest News
    • Newsletters
    • Letters
    • Free Reports and Guides
    • Professional Development
    • Virtual Events
    • Chronicle Store
    • Chronicle Intelligence
    • Jobs in Higher Education
    • Post a Job
  • Know The Chronicle
    • About Us
    • Vision, Mission, Values
    • DEI at The Chronicle
    • Write for Us
    • Work at The Chronicle
    • Our Reporting Process
    • Advertise With Us
    • Brand Studio
    • Accessibility Statement
  • Account and Access
    • Manage Your Account
    • Manage Newsletters
    • Individual Subscriptions
    • Group and Institutional Access
    • Subscription & Account FAQ
  • Get Support
    • Contact Us
    • Reprints & Permissions
    • User Agreement
    • Terms and Conditions
    • Privacy Policy
    • California Privacy Policy
    • Do Not Sell My Personal Information
1255 23rd Street, N.W. Washington, D.C. 20037
© 2025 The Chronicle of Higher Education
The Chronicle of Higher Education is academe’s most trusted resource for independent journalism, career development, and forward-looking intelligence. Our readers lead, teach, learn, and innovate with insights from The Chronicle.
Follow Us
  • twitter
  • instagram
  • youtube
  • facebook
  • linkedin