How Novice Programmers Use and Experience ChatGPT when Solving Programming Exercises in an Introductory Course
Project Overview
The document explores the role of generative AI, specifically ChatGPT, in introductory programming education, underscoring the importance of educators understanding how students engage with these technologies to improve learning outcomes. It reveals that students utilize ChatGPT for various tasks, including code generation and debugging, while also facing challenges such as inaccuracies and a tendency towards over-reliance on the tool. The research indicates that students recognize the value of generative AI in their studies; however, it raises significant concerns about its effects on learning processes and issues related to academic integrity. Overall, the findings highlight the potential benefits of integrating AI tools in educational settings, coupled with the need for careful consideration of their implications for effective teaching and ethical practices.
Key Applications
ChatGPT-3.5
Context: Introductory programming course for first-year computing students at Goethe University, Frankfurt.
Implementation: Students solved programming exercises using ChatGPT without prior instruction on its use, submitting their prompts and responses via the university's learning management system.
Outcomes: Students frequently used ChatGPT for problem understanding, code generation, debugging, and documentation. Majority reported positive experiences regarding ease of use, skill improvement, and overall satisfaction.
Challenges: Students experienced issues with the accuracy of responses, hallucinations, and a tendency to over-rely on the tool, which could hinder independent problem-solving.
Implementation Barriers
Technical Limitations
Generative AI tools can produce inaccurate information (hallucinations) and may not always provide reliable solutions.
Proposed Solutions: Educators need to establish guidelines for using these tools, emphasizing the importance of verification and critical thinking.
Student Dependency
Students may become overly reliant on AI tools like ChatGPT, potentially hindering their independent programming skills development.
Proposed Solutions: Instructors should integrate discussions about the ethical use of AI and promote strategies to encourage independent problem-solving.
Project Team
Andreas Scholl
Researcher
Natalie Kiesler
Researcher
Contact Information
For information about the paper, please contact the authors.
Authors: Andreas Scholl, Natalie Kiesler
Source Publication: View Original PaperLink opens in a new window
Project Contact: Dr. Jianhua Yang
LLM Model Version: gpt-4o-mini-2024-07-18
Analysis Provider: Openai