Introduction

The rapidly evolving landscape of artificial intelligence (AI) in education has presented significant challenges in assessing student learning authentically. As both students and educators express concerns over reverting to 100% examinations or implementing heavy-handed changes, there is a clear need for space to explore effective assessment methods within an informed and structured framework. Implementing oral examinations, or VIVAs, emerges as a potential strategy to enhance academic integrity by requiring students to present and defend their work verbally. While not necessary for all assessments, VIVAs can increase the sense of accountability and provide a more direct measure of individual understanding. However, like all approaches discussed, VIVAs are not a perfect solution. They come with challenges related to resources, scalability, equity, and the possibility of AI assistance during the examination. This section delves into the complexities of incorporating VIVAs into the assessment process, acknowledging the multifaceted nature of the issue and exploring how they can be part of a balanced approach to assessment in the AI era.

The Role of VIVAs in the Current Educational Landscape

Oral examinations have a longstanding history in education, traditionally used in disciplines such as medicine, law, and the humanities to assess depth of knowledge and critical thinking skills. In the context of AI's influence on education, VIVAs offer a way to verify a student's understanding directly, reducing the reliance on written work that could be generated or enhanced by AI tools. By engaging students in a dialogue about their work, educators can probe the reasoning behind answers, assess comprehension, and observe problem-solving abilities in real-time.

Moreover, incorporating various forms of public verification, such as peer VIVAs and problem-solving on the board, can provide additional avenues for authentic assessment. These methods encourage collaboration, allow for peer feedback, and give students a sense of control over their learning process. By experimenting with different formats on a module-by-module basis, educators and students can find approaches that best suit their specific contexts and needs.

Benefits of Implementing Oral Examinations

1. Authentic Assessment of Understanding

VIVAs allow educators to evaluate a student's knowledge and reasoning processes directly. Through questioning and discussion, educators can assess not just the correctness of answers but the depth of understanding and ability to apply concepts.

2. Enhancement of Communication Skills

Engaging in oral examinations helps students develop verbal communication and presentation skills, which are valuable in professional and academic contexts. It encourages clear articulation of ideas and the ability to think on one's feet.

3. Encouraging Collaborative Learning

Implementing peer VIVAs and group discussions fosters a collaborative learning environment. Students can learn from each other, receive diverse perspectives, and develop critical feedback skills. This collaborative approach can enhance engagement and deepen understanding.

4. Reduction of AI Misuse

By requiring real-time responses, VIVAs limit the opportunity for students to rely on AI assistance during the examination. This makes it more challenging to present AI-generated content as one's own work.

5. Immediate Feedback and Interaction

Oral exams provide an opportunity for immediate feedback. Educators can clarify misunderstandings on the spot, and students can engage in a two-way dialogue that enhances learning.

Challenges and Limitations of VIVAs

Despite the potential benefits, implementing VIVAs is not without significant challenges:

1. Resource Intensiveness and Scalability

Conducting individual oral examinations requires substantial time and staffing. In large classes, it may be impractical to allocate sufficient time for each student, making scalability a primary concern.

2. Equity and Accessibility Concerns

VIVAs may disadvantage students with social anxiety, language barriers, or disabilities that affect communication. Ensuring equitable assessment requires accommodations and sensitivity to diverse student needs.

3. Potential for AI Assistance

As AI technology advances, real-time assistance through hidden devices could become feasible, challenging the integrity of oral examinations. Policing against such misuse may be difficult without infringing on privacy.

4. Stress and Performance Anxiety

The high-pressure environment of an oral exam can induce significant stress, potentially impacting a student's ability to perform and not accurately reflecting their understanding.

5. Consistency in Evaluation

Subjectivity in questioning and grading can lead to inconsistencies. Without clear criteria and training, different examiners may assess students unevenly.

6. Challenges in Peer Assessment

While peer VIVAs can promote engagement, they may also introduce issues with bias, reliability, and discomfort among students in assessing their peers. Proper guidance and frameworks are necessary to mitigate these challenges.

Implementation Strategies for Effective VIVAs

To address these challenges, institutions can consider the following strategies:

1. Selective Application and Flexibility

Use VIVAs for key assessments, capstone projects, or as a supplementary tool rather than for all evaluations. Allow flexibility for educators and students to experiment with various forms of oral assessments, such as peer VIVAs or group presentations, tailored to the specific needs of each module.

2. Group Oral Examinations and Peer VIVAs

Conducting VIVAs in small groups or incorporating peer assessment can reduce resource demands while promoting collaborative learning. Peer VIVAs enable students to engage critically with each other's work, fostering a deeper understanding and shared responsibility for learning.

3. Clear Evaluation Criteria

Develop transparent and consistent grading rubrics. Training examiners and providing guidelines for peer assessments enhance fairness and reliability in evaluation.

4. Providing Support and Preparation

Offer students resources and opportunities to practice, such as mock VIVAs, workshops on presentation skills, and guidance on providing constructive peer feedback. This support can alleviate anxiety and improve performance.

5. Accommodations for Diverse Needs

Implement policies to accommodate students with disabilities, language challenges, or anxiety disorders. Options may include extended preparation time, alternative assessment formats, or the presence of support personnel.

6. Integration with Other Assessment Methods

Combine VIVAs with written assignments, projects, or practical tasks to create a comprehensive assessment strategy that captures different aspects of student learning. Encouraging problem-solving on the board or public presentations can add variety and address different learning styles.

7. Empowering Educators and Students

Provide educators and students with the space and support to consider and experiment with various forms of public verification. This proactive approach involves stakeholders directly, giving them a sense of control and ownership over the assessment process without overwhelming them.

Equity Considerations in VIVA Implementation

Ensuring that VIVAs are fair and accessible requires deliberate attention to equity:

1. Cultural Sensitivity

Be aware of cultural differences in communication styles and respect. Examiners should be trained to recognise and accommodate these differences to prevent bias.

2. Language Support

For non-native speakers, providing language assistance or allowing responses in their preferred language (where feasible) can help demonstrate true understanding.

3. Transparency in Expectations

Clearly communicate the format, expectations, and criteria of the VIVA. Providing example questions and evaluation rubrics helps students prepare adequately.

4. Confidentiality and Comfort

Ensure that the examination environment is private and respectful. Minimising distractions and creating a supportive atmosphere can alleviate stress.

5. Support for Peer Assessments

Provide guidance on how to give and receive feedback constructively. Establishing norms and expectations for peer VIVAs can promote a positive and respectful learning environment.

Addressing the Limitations of VIVAs

Recognising that VIVAs are not a panacea, it's important to address their limitations proactively:

1. Resource Management

Plan schedules and staffing carefully to manage the increased workload. While technology, such as video conferencing tools, can facilitate scheduling and reduce logistical constraints, it may also increase the potential for AI-augmented presentations and misuse. Therefore, additional safeguards should be considered to maintain the integrity of the assessment process.

2. Mitigating AI Assistance Risks

While policing against hidden devices is challenging, creating an environment that discourages misuse through honour codes and emphasising the value of integrity can be more effective. Encouraging peer accountability in group settings can also reinforce ethical behaviour.

3. Continuous Evaluation and Improvement

Gather feedback from students and educators to identify areas for improvement. Adjusting approaches based on experience helps enhance the effectiveness and fairness of VIVAs over time.

4. Encouraging Experimentation and Flexibility

Allow educators and students the space to consider and experiment with different forms of oral assessments. This flexibility can lead to innovative practices that are better suited to specific modules and learning objectives, fostering a proactive and adaptive educational environment.

Conclusion

Implementing oral examinations presents a potential avenue for enhancing academic integrity and assessing student understanding in the face of AI's growing influence in education. While VIVAs offer direct interaction and can reduce reliance on AI-generated work, they are not without significant challenges. Resource constraints, equity concerns, and the potential for AI assistance during the examination complicate their implementation. Recognising these complexities, it is essential to approach VIVAs as part of a broader, balanced assessment strategy rather than a standalone solution.

By thoughtfully integrating various forms of oral assessments, such as peer VIVAs and public problem-solving, educators and students can collaboratively explore methods that enhance learning and integrity. Providing space for experimentation and involving stakeholders directly empowers them to adapt confidently, fostering a sense of control and ownership over the educational process without overwhelming them. This collaborative and flexible approach allows institutions to navigate the rapidly changing educational landscape effectively, embracing new methods while acknowledging and addressing inherent challenges.