Skip to main content Skip to navigation

MindScratch: A Visual Programming Support Tool for Classroom Learning Based on Multimodal Generative AI

Project Overview

The document discusses the innovative application of generative AI in education, focusing on MindScratch, a multimodal visual programming support tool tailored for K-12 students. This tool is designed to enhance computational thinking and creativity by offering structured guidance aligned with classroom objectives. MindScratch enables teachers to set specific learning goals and supports project-based learning through interactive mind maps that decompose tasks and provide personalized assistance. User studies demonstrate that MindScratch significantly improves project quality, fosters creativity, and better aligns students' work with educational objectives compared to conventional programming tools. Overall, the findings highlight the potential of generative AI to transform educational approaches, making learning more engaging and effective for students.

Key Applications

MindScratch

Context: K-12 education, specifically for fifth-grade students learning programming.

Implementation: Implemented as a multimodal generative AI tool that allows teachers to set learning objectives and provides students with guided support in creating programming projects.

Outcomes: Students achieved high-quality projects aligned with learning objectives, improved computational thinking skills, and increased creativity.

Challenges: Challenges include ensuring that students do not rely too heavily on AI-generated solutions, maintaining engagement with the material, and managing the cognitive load of using the tool.

Implementation Barriers

Educational Practice

The need for structured guidance and alignment with specific educational objectives in programming education. Students may become over-reliant on the tool and neglect deeper engagement with programming concepts.

Proposed Solutions: MindScratch's design incorporates teacher-defined objectives into the learning process, ensuring that students stay focused on the learning goals. Encourage students to actively explore programming logic before seeking assistance from MindScratch.

Technological Limitations

Potential inaccuracies in AI-generated content may mislead students, especially those with weaker programming foundations.

Proposed Solutions: Implement systematic courses and quizzes before using MindScratch to improve understanding and critical thinking.

Project Team

Yunnong Chen

Researcher

Shuhong Xiao

Researcher

Yaxuan Song

Researcher

Zejian Li

Researcher

Lingyun Sun

Researcher

Liuqing Chen

Researcher

Contact Information

For information about the paper, please contact the authors.

Authors: Yunnong Chen, Shuhong Xiao, Yaxuan Song, Zejian Li, Lingyun Sun, Liuqing Chen

Source Publication: View Original PaperLink opens in a new window

Project Contact: Dr. Jianhua Yang

LLM Model Version: gpt-4o-mini-2024-07-18

Analysis Provider: Openai

Let us know you agree to cookies