Repurposing Text-Generating AI into a Thought-Provoking Writing Tutor
Project Overview
The document explores the application of generative AI in education, specifically through the development of Scraft, an innovative AI writing-support tool designed to enhance writing education. By employing recursive feedback based on Socratic questioning, Scraft aims to bolster critical thinking and writing skills through iterative engagement rather than traditional linear feedback methods. A preliminary study conducted with university students revealed that Scraft was effective in improving writing skills; however, it also highlighted challenges concerning the relevance and accuracy of the feedback provided by the tool. Overall, the findings suggest that while generative AI like Scraft has the potential to transform writing education by fostering deeper engagement and critical analysis, it must overcome certain limitations to maximize its effectiveness in supporting students' learning experiences.
Key Applications
Scraft - an AI writing-support tool that provides recursive feedback based on Socratic questioning.
Context: University writing class with students working on writing assignments.
Implementation: Implemented as a prototype AI tool that generates Socratic questions to facilitate critical thinking during the writing process.
Outcomes: Participants reported improved writing skills and deeper understanding of their topics due to the recursive feedback and Socratic questioning.
Challenges: Some Socratic questions lacked relevance, were factually incorrect, or contradicted each other.
Implementation Barriers
Technical
The AI-generated Socratic questions sometimes lack relevance and factual accuracy.
Proposed Solutions: Further research is needed to refine AI feedback mechanisms and ensure alignment with pedagogical principles.
Project Team
Tae Wook Kim
Researcher
Quan Tan
Researcher
Contact Information
For information about the paper, please contact the authors.
Authors: Tae Wook Kim, Quan Tan
Source Publication: View Original PaperLink opens in a new window
Project Contact: Dr. Jianhua Yang
LLM Model Version: gpt-4o-mini-2024-07-18
Analysis Provider: Openai