Perception, performance, and detectability of conversational artificial intelligence across 32 university courses
Project Overview
The document explores the role of generative AI, especially ChatGPT, in education, underscoring its ability to generate human-like text and the associated challenges to academic integrity. A comparative study across 32 university-level courses indicates that ChatGPT's performance often matches or exceeds that of students, raising concerns about the implications for learning and assessment. Furthermore, the text addresses the complexities of identifying AI-generated content, which complicates the enforcement of academic standards. It also reflects on the varying attitudes of students and educators towards the integration of AI tools in academic work, suggesting a need for a thoughtful approach to harnessing the benefits of generative AI while mitigating risks. Overall, the findings highlight the transformative potential of generative AI in education and the necessity for ongoing dialogue around its ethical and practical use in learning environments.
Key Applications
ChatGPT
Context: University-level courses across various disciplines, targeting both students and educators.
Implementation: ChatGPT was used to generate answers to exam questions, which were compared to student responses for grading.
Outcomes: ChatGPT's performance was comparable or superior to that of students in many courses, indicating its potential as both a tool and a challenge in educational contexts.
Challenges: Current AI text classifiers struggle to detect ChatGPT-generated content accurately, leading to concerns about academic integrity.
Implementation Barriers
Technological
Current AI detection algorithms misclassify human-written text as AI-generated and vice versa, making it hard to enforce academic integrity.
Proposed Solutions: Educational institutions may need to develop new evaluation frameworks or revert to traditional assessment methods to mitigate AI's impact.
Ethical
There are conflicting views among students and educators regarding the ethical implications of using AI tools like ChatGPT in academic work.
Proposed Solutions: Establishing clear policies and guidelines regarding the permissible use of AI tools in education could help address ethical concerns.
Project Team
Hazem Ibrahim
Researcher
Fengyuan Liu
Researcher
Rohail Asim
Researcher
Balaraju Battu
Researcher
Sidahmed Benabderrahmane
Researcher
Bashar Alhafni
Researcher
Wifag Adnan
Researcher
Tuka Alhanai
Researcher
Bedoor AlShebli
Researcher
Riyadh Baghdadi
Researcher
Jocelyn J. Bélanger
Researcher
Elena Beretta
Researcher
Kemal Celik
Researcher
Moumena Chaqfeh
Researcher
Mohammed F. Daqaq
Researcher
Zaynab El Bernoussi
Researcher
Daryl Fougnie
Researcher
Borja Garcia de Soto
Researcher
Alberto Gandolfi
Researcher
Andras Gyorgy
Researcher
Nizar Habash
Researcher
J. Andrew Harris
Researcher
Aaron Kaufman
Researcher
Lefteris Kirousis
Researcher
Korhan Kocak
Researcher
Kangsan Lee
Researcher
Seungah S. Lee
Researcher
Samreen Malik
Researcher
Michail Maniatakos
Researcher
David Melcher
Researcher
Azzam Mourad
Researcher
Minsu Park
Researcher
Mahmoud Rasras
Researcher
Alicja Reuben
Researcher
Dania Zantout
Researcher
Nancy W. Gleason
Researcher
Kinga Makovi
Researcher
Talal Rahwan
Researcher
Yasir Zaki
Researcher
Contact Information
For information about the paper, please contact the authors.
Authors: Hazem Ibrahim, Fengyuan Liu, Rohail Asim, Balaraju Battu, Sidahmed Benabderrahmane, Bashar Alhafni, Wifag Adnan, Tuka Alhanai, Bedoor AlShebli, Riyadh Baghdadi, Jocelyn J. Bélanger, Elena Beretta, Kemal Celik, Moumena Chaqfeh, Mohammed F. Daqaq, Zaynab El Bernoussi, Daryl Fougnie, Borja Garcia de Soto, Alberto Gandolfi, Andras Gyorgy, Nizar Habash, J. Andrew Harris, Aaron Kaufman, Lefteris Kirousis, Korhan Kocak, Kangsan Lee, Seungah S. Lee, Samreen Malik, Michail Maniatakos, David Melcher, Azzam Mourad, Minsu Park, Mahmoud Rasras, Alicja Reuben, Dania Zantout, Nancy W. Gleason, Kinga Makovi, Talal Rahwan, Yasir Zaki
Source Publication: View Original PaperLink opens in a new window
Project Contact: Dr. Jianhua Yang
LLM Model Version: gpt-4o-mini-2024-07-18
Analysis Provider: Openai