Test Item Analysis for English Teachers:
Applying Classical Test Theory using Excel
Chihiro Inoue, CRELLA, University of Bedfordshire, chihiro.inoue(a)beds.ac.uk
Sathena Chan,CRELLA, University of Bedfordshire, sathena.chan(a)beds.ac.uk
Carolyn Westbrook,Southampton Solent University, carolyn.westbrook(a)solent.ac.uk
Summary of workshop:
This workshop aims to provide foreign language teachers with hands-on sessions on conducting basic item analysis using classical test theory (CTT). Using sample data sets in Excel spreadsheets, various functions will be introduced to calculate descriptive statistics (e.g., frequency tables, histograms, central tendency and dispersion) and reliability, as well as to conduct item analysis (e.g., facility values and discrimination, i.e. point biserial, distractor analysis).
Along with the hands-on session, lecture sessions are also given (using sample items from different item types) to raise awareness in test design, item writing, scoring methods and inputting data into spreadsheets. The intended learning outcomes are:
- An understanding of key concepts in language testing
- An understanding of the thinking behind item analysis in CTT
- An understanding of the functions for item analysis in Excel.
By using Excel, this workshop can provide English teachers with more accessible means for conducting their own item analysis in CTT. Teachers will also benefit from being able to take home the Excel templates for their own future use.
Provisional schedule and contents:
14.00 – 15.30 Introducing types of tests and testing / Item types and scoring methods / Guidelines for writing good items
15.45 – 17.15 Entering data into Excel
9.00 – 10.30 Calculating and displaying descriptive statistics using graphs
10.30 – 10.45 BREAK
10.45 – 12.15 Calculating facility values, discrimination and distractor analysis
12.15 – 13.30 LUNCH
13.30 – 15.00 Calculating reliability (1) Cronbach’s Alpha
15.00 – 15.15 BREAK
15.15 – 16.45 Calculating reliability (2): Rater reliability / Guidelines to make tests more reliable
9.00 – 10.30 Improving test items that are identified as problematic
10.30 – 10.45 BREAK
10.45 – 12.00 Interpreting the results to feed back to teaching and future tests / Round-up and close
Prior knowledge required:
- Basic knowledge about Excel (i.e. what it looks like and how text / numerical data can be entered)
- Some experience of writing tests and reporting scores at their school
All information (handouts and datasets) will be provided during the workshop. However, if participants have data sets from tests they have run, they can use those to practise the activities we will be doing or for additional practice between sessions.
Please bring your laptop, with Microsoft excel installed (part of the Office package).
Bio-data of Workshop Facilitators:
Please bring your laptop, with Microsoft Excel installed.
Registration is on a first-come first-serve basis, so please book early to avoid disappointment.
We will accept 30 participants.
To register click here.
Warwick Conferences will hold rooms for you at a special price.
A link for booking will be provided in due course.