Skip to main content Skip to navigation

Perception, performance, and detectability of conversational artificial intelligence across 32 university courses

Project Overview

The document explores the role of generative AI, especially ChatGPT, in education, underscoring its ability to generate human-like text and the associated challenges to academic integrity. A comparative study across 32 university-level courses indicates that ChatGPT's performance often matches or exceeds that of students, raising concerns about the implications for learning and assessment. Furthermore, the text addresses the complexities of identifying AI-generated content, which complicates the enforcement of academic standards. It also reflects on the varying attitudes of students and educators towards the integration of AI tools in academic work, suggesting a need for a thoughtful approach to harnessing the benefits of generative AI while mitigating risks. Overall, the findings highlight the transformative potential of generative AI in education and the necessity for ongoing dialogue around its ethical and practical use in learning environments.

Key Applications

ChatGPT

Context: University-level courses across various disciplines, targeting both students and educators.

Implementation: ChatGPT was used to generate answers to exam questions, which were compared to student responses for grading.

Outcomes: ChatGPT's performance was comparable or superior to that of students in many courses, indicating its potential as both a tool and a challenge in educational contexts.

Challenges: Current AI text classifiers struggle to detect ChatGPT-generated content accurately, leading to concerns about academic integrity.

Implementation Barriers

Technological

Current AI detection algorithms misclassify human-written text as AI-generated and vice versa, making it hard to enforce academic integrity.

Proposed Solutions: Educational institutions may need to develop new evaluation frameworks or revert to traditional assessment methods to mitigate AI's impact.

Ethical

There are conflicting views among students and educators regarding the ethical implications of using AI tools like ChatGPT in academic work.

Proposed Solutions: Establishing clear policies and guidelines regarding the permissible use of AI tools in education could help address ethical concerns.

Project Team

Hazem Ibrahim

Researcher

Fengyuan Liu

Researcher

Rohail Asim

Researcher

Balaraju Battu

Researcher

Sidahmed Benabderrahmane

Researcher

Bashar Alhafni

Researcher

Wifag Adnan

Researcher

Tuka Alhanai

Researcher

Bedoor AlShebli

Researcher

Riyadh Baghdadi

Researcher

Jocelyn J. Bélanger

Researcher

Elena Beretta

Researcher

Kemal Celik

Researcher

Moumena Chaqfeh

Researcher

Mohammed F. Daqaq

Researcher

Zaynab El Bernoussi

Researcher

Daryl Fougnie

Researcher

Borja Garcia de Soto

Researcher

Alberto Gandolfi

Researcher

Andras Gyorgy

Researcher

Nizar Habash

Researcher

J. Andrew Harris

Researcher

Aaron Kaufman

Researcher

Lefteris Kirousis

Researcher

Korhan Kocak

Researcher

Kangsan Lee

Researcher

Seungah S. Lee

Researcher

Samreen Malik

Researcher

Michail Maniatakos

Researcher

David Melcher

Researcher

Azzam Mourad

Researcher

Minsu Park

Researcher

Mahmoud Rasras

Researcher

Alicja Reuben

Researcher

Dania Zantout

Researcher

Nancy W. Gleason

Researcher

Kinga Makovi

Researcher

Talal Rahwan

Researcher

Yasir Zaki

Researcher

Contact Information

For information about the paper, please contact the authors.

Authors: Hazem Ibrahim, Fengyuan Liu, Rohail Asim, Balaraju Battu, Sidahmed Benabderrahmane, Bashar Alhafni, Wifag Adnan, Tuka Alhanai, Bedoor AlShebli, Riyadh Baghdadi, Jocelyn J. Bélanger, Elena Beretta, Kemal Celik, Moumena Chaqfeh, Mohammed F. Daqaq, Zaynab El Bernoussi, Daryl Fougnie, Borja Garcia de Soto, Alberto Gandolfi, Andras Gyorgy, Nizar Habash, J. Andrew Harris, Aaron Kaufman, Lefteris Kirousis, Korhan Kocak, Kangsan Lee, Seungah S. Lee, Samreen Malik, Michail Maniatakos, David Melcher, Azzam Mourad, Minsu Park, Mahmoud Rasras, Alicja Reuben, Dania Zantout, Nancy W. Gleason, Kinga Makovi, Talal Rahwan, Yasir Zaki

Source Publication: View Original PaperLink opens in a new window

Project Contact: Dr. Jianhua Yang

LLM Model Version: gpt-4o-mini-2024-07-18

Analysis Provider: Openai

Let us know you agree to cookies