6. Concerns and Future Directions
- Home
- 1.Formal Report
- 1.1 Introduction to Project
- 1.2 The Emergence of ChatGPT and Limitations of GPT-3.5
- 1.3 Understanding LLMs and Evolution of AI Models
- 1.4 Extending LLM Capabilities and Introduction of ChatGPT o1
- 1.5 A Step Change in AI Capabilities and Key Findings
- 1.6 Performance of AI Models and Urgency for Institutional Action
- 1.7 Recognising the Problem and Specific Regulations
- 1.8 Recommendations and Conclusion
- 2. Student Conversations
- 3. How ChatGPT Performed on University-Level Work
- 4. Suggested Changes and Future Direction of Regulations
- 4.1 Developing Clear Policies on AI Use
- 4.2 Enhancing Student Support and Guidance
- 4.3 Emphasising Skills That AI Cannot Replicate
- 4.4 Adapting Pedagogy and Innovating Assessments
- 4.5 Encouraging Collaborative Solutions Among Stakeholders
- 4.6 Allocating Resources for Training and Support
- 4.7 Adopting Alternative Assessment Methods
- 4.8 Relying on Honour Codes and Academic Integrity Pledges
- 4.9 Designing AI-Resistant Assignments
- 4.10 Using AI Detection Software
- 4.11 Implementing Oral Examinations (VIVAs)
- 5 Opportunities AI Presents
- 6 Tips For Markers on Spotting Potential AI Usage
This section explores the concerns raised by mathematics and statistics students at Warwick University about the future implications of AI in education. It discusses potential impacts on learning outcomes, career prospects, and the evolution of teaching methods based on survey responses from 145 students, with 59% reporting they have used AI to help complete assignments.
Perceptions of AI Accuracy in Mathematics and Statistics
Key Findings:
- A significant 78% of AI users agree or strongly agree that "AI usually gives the wrong answer to maths/stats questions."
- 64% of non-AI users share this perception.
- Only 5% of AI users disagree with this statement, indicating a general lack of trust in AI's accuracy among students.
Note: Click on the graph labels (e.g., "AI Users", "Non-Users", or "Combined") to view each group's data separately.
Concerns About AI's Impact on Future Career Plans
Key Findings:
- 33% of AI users and 49% of non-AI users agree or strongly agree that they are concerned "AI will undermine my future career plans."
- Overall, 40% of all students are worried about AI's impact on their future careers.
- A majority of AI users (45%) disagree with this concern, suggesting varied perceptions.
Note: Click on the graph labels (e.g., "AI Users", "Non-Users", or "Combined") to view each group's data separately.
Opinions on Shifting to 100% In-Person Exams
Key Findings:
- A majority of both AI users (78%) and non-AI users (69%) disagree or strongly disagree with moving to 100% in-person exams and removing assignments from final grades.
- Only 16% of AI users and 14% of non-AI users agree with this shift.
- This indicates a preference for maintaining a mix of assessment methods despite AI advancements.
Note: Click on the graph labels (e.g., "AI Users", "Non-Users", or "Combined") to view each group's data separately.
Uncertainty About AI Use in Assignments
Key Findings:
- Approximately 35% of all students agree or strongly agree that they are "not sure how I feel about the use of AI in assignments."
- This uncertainty is slightly higher among non-AI users (37%) compared to AI users (34%).
- Only 13% of students strongly disagree with this statement, showing widespread ambivalence.
Note: Click on the graph labels (e.g., "AI Users", "Non-Users", or "Combined") to view each group's data separately.
In-Depth Analysis of Student Concerns and Future Directions
1. Widespread Skepticism About AI's Accuracy in Mathematics and Statistics
The survey reveals that a significant majority of both AI users (78%) and non-AI users (64%) believe that AI usually gives the wrong answers to maths and statistics questions. This skepticism may stem from personal experiences with AI tools that failed to provide correct solutions, as well as a general mistrust in AI's capabilities in handling complex, technical subjects.
2. Concerns Over AI Undermining Future Career Plans
A notable proportion of students are worried that AI could negatively impact their future careers. With 49% of non-AI users and 33% of AI users expressing this concern, it's clear that apprehensions about AI's potential to disrupt job markets and make certain skills obsolete are prevalent. This aligns with earlier findings on the Impact on Academic Standing and Degree Value, where students feared AI could devalue their degrees.
3. Resistance to Eliminating Assignments from Final Grades
Despite challenges in keeping up with AI advancements, a majority of students oppose moving to 100% in-person exams and removing assignments from final grade calculations. Both AI users (78%) and non-AI users (69%) prefer to retain assignments as part of their assessment. This suggests that students value the role of assignments in their learning process and may believe that other strategies could address AI-related concerns without eliminating assignments.
4. General Uncertainty About AI's Role in Education
Over one-third of students are unsure about how they feel regarding the use of AI in assignments. This ambivalence is shared almost equally between AI users and non-users. It indicates that even among those who have used AI tools, there is uncertainty about the implications of AI integration in education. This could be due to mixed experiences with AI, ethical considerations, or lack of clear guidelines on AI use.
5. Need for Clear Guidance and Policy on AI Use
The combination of skepticism, concern for future careers, resistance to drastic changes in assessment methods, and general uncertainty underscores the need for clear institutional policies and guidance on AI use in education. Students may benefit from resources that improve AI literacy, clarify acceptable use, and address concerns about AI's impact on learning and future employability.
Conclusion and Recommendations
The survey data highlights significant concerns among mathematics and statistics students regarding AI's role in their education and future careers. Despite recognizing AI's potential, students are skeptical of its accuracy in technical subjects, worried about its impact on job prospects, and uncertain about how it should be integrated into their learning experience. There is also resistance to abandoning traditional assessment methods in favor of in-person exams only.
Specific Recommendations
- Improve AI Literacy: Offer workshops and educational resources to help students understand the capabilities and limitations of current AI tools, particularly in mathematics and statistics. This can help reduce skepticism by providing accurate information about AI's performance.
- Develop Clear Policies on AI Use: Establish and communicate clear guidelines on acceptable AI use in assignments and assessments. This can help alleviate uncertainty and ensure that students use AI ethically and effectively.
- Integrate AI Thoughtfully into Curriculum: Design assignments that incorporate AI use in a way that enhances learning while maintaining academic integrity. This approach can help students develop critical skills that are relevant in an AI-influenced job market.
- Provide Career Guidance: Offer support and information on how AI might impact future career paths in mathematics and statistics, helping students to adapt and prepare for changes in the industry.
- Maintain a Balanced Assessment Approach: Retain a mix of assessment methods, including assignments and exams, to cater to diverse learning styles and mitigate the risks associated with AI misuse.
- Foster Open Dialogue: Create forums for students, educators, and industry professionals to discuss concerns and expectations regarding AI in education and the workplace, promoting a collaborative approach to future developments.
By addressing these concerns proactively, educational institutions can help students navigate the challenges posed by AI advancements, ensuring that they are equipped with the knowledge and skills needed for their future careers while maintaining the integrity of their educational experience.