From authoring to reporting - the eAssessment lifecycle
Step 1 Plan your assessment
· Decide on the purpose – diagnostic test, weekly assessment, end of term exam
· Choose question types you want to use
· Consider feedback/links
· Consider time limits, plan for conditional assessment
Step 2 Create question bank
· Create topics before you start adding question
· Use different question types, do not simplify your assessment to MCQ only
· Consider randomising order of answers for MCQ and MRQ questions
Step 3 Design assessment
· Choose what questions from what topics you want to include in one assessment
· Consider the time limit for the assessment
· Add feedback for formative assessment
· Consider conditional assessment options
Step 4 Verification/peer review
· Create a test assessment to include all your questions with marking and feedback
· Schedule this test assessment to yourself and colleagues, attempt all question, check marking schema and feedback
· Schedule the normal assessment to yourself and colleagues to mirror the student experience
Test assessment whether it works properly:
- Are you happy with the layout/design?
- Are you using the accessibility functions?
- Do you need a special character palette?
- Is the scoring correct?
- Is the feedback correct?
- Are there alternative answers that are correct as well?
- Is the time setting correct?
· Mark this assessment as approved, so it is ready for students
Step 5 Scheduling
Contact eAssessment Team eassessment@warwick.ac.uk and request the assessment to be scheduled. You need to provide the following information:
- Start and end time for the assessment
- Do you require Secure exam delivery
- List of users taking the exam
- List of users with extra time
- Is there a time limit for the exam/assessment
- Number of attempts
- Room booking (if required)
- Do you need headphones or other equipment?
Step 6 Delivery
· Students will receive an email confirming start/end time of the assessment
· eAssessment team will provide technical support during the assessment time
At least one member of the eAssessment team will be joining you for the exams if required. We can help to make sure all students are taking the exam under Secure conditions and help out with other technical issues.
Alternatively, an assessment can be set up to be accessed via an open link. This is suitable for when you don’t know who will be taking the assessment in advance.
Step 7 Reports
· QM Perception users with admin rights on the assessment can pull the results and create reports as soon as the students have finalised the assessment. Reporting functionalities include:
- Demographics filter
- Question item performance analysis
- User grouping to compare different sets of students
- Breakdown of results by assessment, topic or item
The results can be downloaded in HTML, PDF or CSV.
Have a look at the analytics features in this short video
Step 8 Assessment review
· Can be done using QMP assessment review and question performance tools.
Revise the questions and assessment critically and amend accordingly:
- Have a close look at questions with a particularly high and particularly low item level performance: Where they too hard/easy? Could there be a misunderstanding? Could there be alternative correct answers?
- Did students complain about a certain question or aspect of the assessment? Is the complaint justified? How could it be resolved? (No need to necessarily give in.)
- Will you change the content of the lecture? Change the questions accordingly.
- Are there new features in QM Perception which you can make use of?
- Has the course literature changed to which you make reference in the feedback? Please change the feedback accordingly.
Contents
- Introduction to eStream
- Access your eStream content
- Uploading videos to eStream
- Edit videos in eStream
- Edit video thumbnail
- Uploading a closed captions (subtitles) file to eStream
- Add eStream videos to Mahara
- Sharing eStream videos to Moodle
- Sharing an eStream video with a link
- Setup a video assignment in Moodle