Distinguishing Fact from Fiction: Student Traits, Attitudes, and AI Hallucination Detection in Business School Assessment
Project Overview
The document explores the role of generative AI in education, particularly focusing on the challenges posed by AI hallucinations in management education. It underscores the necessity of developing critical skills such as AI literacy, epistemic cognition, and interpretive reasoning to effectively identify inaccuracies generated by AI systems. Research findings highlight that students with strong academic performance, writing skills, and a healthy skepticism towards AI are better equipped to recognize these hallucinations. Additionally, the study concludes that while rote learning falls short in this context, providing structured feedback can enhance students' understanding and performance. To address these issues, the document advocates for the integration of AI literacy into educational curricula, aiming to promote critical engagement with AI technologies and ensure responsible usage among students.
Key Applications
Using AI tools like ChatGPT to generate responses for coursework assessment
Context: Business school, Year 2 economics and management students
Implementation: Students were tasked with evaluating AI-generated responses for accuracy in a high-stakes assessment setting.
Outcomes: Only 20% of students successfully identified AI hallucinations. Strong academic performance and interpretive skills were correlated with improved detection.
Challenges: Low overall detection rates highlight the prevalence of AI hallucinations and the need for improved educational interventions.
Implementation Barriers
Technical
The tendency of generative AI to produce coherent yet factually incorrect information (hallucinations).
Proposed Solutions: Integrating structured feedback and AI literacy into the curriculum to enhance students' critical evaluation skills.
Cognitive
Students' reliance on rote knowledge application, which proved less effective in detecting inaccuracies.
Proposed Solutions: Promoting higher-order thinking skills and critical reasoning through curriculum design.
Project Team
Canh Thien Dang
Researcher
An Nguyen
Researcher
Contact Information
For information about the paper, please contact the authors.
Authors: Canh Thien Dang, An Nguyen
Source Publication: View Original PaperLink opens in a new window
Project Contact: Dr. Jianhua Yang
LLM Model Version: gpt-4o-mini-2024-07-18
Analysis Provider: Openai