Deep Learning Detection Method for Large Language Models-Generated Scientific Content
Project Overview
The document explores the impact of generative AI, especially large language models (LLMs) such as ChatGPT, on the integrity of educational content by highlighting concerns over plagiarism and misinformation in academic research. It addresses the challenge posed by AI's ability to produce texts that closely resemble human-written work, which complicates the detection of academic dishonesty. To combat this issue, the authors introduce a new detection tool called AI-Catcher, which utilizes a combination of multilayer perceptron (MLP) and convolutional neural networks (CNN) to effectively identify AI-generated scientific texts. This innovative approach shows significant advancements in detection accuracy compared to existing methods, underscoring the critical need to uphold academic integrity within educational contexts. The findings indicate that while generative AI presents opportunities for enhancing learning and content creation, it also necessitates robust mechanisms to ensure that the authenticity and credibility of academic work are preserved.
Key Applications
AI-Catcher
Context: Detection of AI-generated scientific texts for academic integrity
Implementation: AI-Catcher uses a multimodal architecture combining MLP and CNN for detecting ChatGPT-generated scientific content.
Outcomes: Achieved an average accuracy improvement of 38.8% over existing methods in distinguishing between human-written and AI-generated texts.
Challenges: Potential ethical concerns regarding the use of AI in generating scientific content and the need for continuous adaptation of detection methods.
Implementation Barriers
Ethical
The emergence of AI tools raises concerns about plagiarism and the integrity of academic publications.
Proposed Solutions: Implementing robust detection methods like AI-Catcher can help mitigate these risks.
Project Team
Bushra Alhijawi
Researcher
Rawan Jarrar
Researcher
Aseel AbuAlRub
Researcher
Arwa Bader
Researcher
Contact Information
For information about the paper, please contact the authors.
Authors: Bushra Alhijawi, Rawan Jarrar, Aseel AbuAlRub, Arwa Bader
Source Publication: View Original PaperLink opens in a new window
Project Contact: Dr. Jianhua Yang
LLM Model Version: gpt-4o-mini-2024-07-18
Analysis Provider: Openai