Enhancing Critical Thinking in Generative AI Search with Metacognitive Prompts
Project Overview
The document explores the integration of Generative AI (GenAI) in education, specifically examining its impact on enhancing critical thinking among university students. It highlights the potential risks of passive engagement as students may overly rely on GenAI for information retrieval. To counter this, the study introduces metacognitive prompts designed to foster reflection, evaluation, and deeper inquiry during the information search process. The findings reveal that these prompts effectively increased student engagement, encouraged exploration of diverse topics, and improved critical thinking skills. However, some participants exhibited resistance to using the prompts, attributing it to overconfidence in their abilities or skepticism regarding the limitations of the GenAI tool. Overall, the research underscores the importance of balancing GenAI support with strategies that promote active learning and critical engagement to maximize educational outcomes.
Key Applications
Use of metacognitive prompts in GenAI search tools like Perplexity.ai
Context: University students engaging in research on the impacts of AI on education
Implementation: A between-subjects user study with metacognitive prompts delivered during a search task
Outcomes: Increased search engagement, more follow-up queries, and enhanced critical thinking skills
Challenges: Participants' pre-existing confidence and biases affecting their engagement with prompts
Implementation Barriers
Cognitive Barrier
Participants exhibited cognitive offloading, relying on GenAI responses without critical engagement. Some participants found the prompts distracting or unhelpful, impacting their engagement.
Proposed Solutions: Incorporate metacognitive prompts to encourage self-reflection and deeper inquiry. Provide clear instructions on the purpose of prompts and their potential benefits.
Confidence Barrier
High confidence in their own knowledge led some participants to disregard the prompts.
Proposed Solutions: Educate users on the capabilities and limitations of GenAI tools to foster critical evaluation.
Project Team
Anjali Singh
Researcher
Zhitong Guan
Researcher
Soo Young Rieh
Researcher
Contact Information
For information about the paper, please contact the authors.
Authors: Anjali Singh, Zhitong Guan, Soo Young Rieh
Source Publication: View Original PaperLink opens in a new window
Project Contact: Dr. Jianhua Yang
LLM Model Version: gpt-4o-mini-2024-07-18
Analysis Provider: Openai