From authoring to reporting - the eAssessment lifecycle
Step 1 Plan your assessment
· Decide on the purpose – diagnostic test, weekly assessment, end of term exam
· Choose question types you want to use
· Consider feedback/links
· Consider time limits, plan for conditional assessment
Step 2 Create question bank
· Create topics before you start adding question
· Use different question types, do not simplify your assessment to MCQ only
· Consider randomising order of answers for MCQ and MRQ questions
Step 3 Design assessment
· Choose what questions from what topics you want to include in one assessment
· Consider the time limit for the assessment
· Add feedback for formative assessment
· Consider conditional assessment options
Step 4 Verification/peer review
· Create a test assessment to include all your questions with marking and feedback
· Schedule this test assessment to yourself and colleagues, attempt all question, check marking schema and feedback
· Schedule the normal assessment to yourself and colleagues to mirror the student experience
Test assessment whether it works properly:
- Are you happy with the layout/design?
- Are you using the accessibility functions?
- Do you need a special character palette?
- Is the scoring correct?
- Is the feedback correct?
- Are there alternative answers that are correct as well?
- Is the time setting correct?
· Mark this assessment as approved, so it is ready for students
Step 5 Scheduling
- Start and end time for the assessment
- Do you require Secure exam delivery
- List of users taking the exam
- List of users with extra time
- Is there a time limit for the exam/assessment
- Number of attempts
- Room booking (if required)
- Do you need headphones or other equipment?
Step 6 Delivery
· Students will receive an email confirming start/end time of the assessment
Step 7 Reports
· QM Perception users with admin rights on the assessment can pull the results and create reports as soon as the students have finalised the assessment. Reporting functionalities include:
- Demographics filter
- Question item performance analysis
- User grouping to compare different sets of students
- Breakdown of results by assessment, topic or item
The results can be downloaded in HTML, PDF or CSV.
Step 8 Assessment review
· Can be done using QMP assessment review and question performance tools.
Revise the questions and assessment critically and amend accordingly:
- Have a close look at questions with a particularly high and particularly low item level performance: Where they too hard/easy? Could there be a misunderstanding? Could there be alternative correct answers?
- Did students complain about a certain question or aspect of the assessment? Is the complaint justified? How could it be resolved? (No need to necessarily give in.)
- Will you change the content of the lecture? Change the questions accordingly.
- Are there new features in QM Perception which you can make use of?
- Has the course literature changed to which you make reference in the feedback? Please change the feedback accordingly.