1.2 Creating a test item repository for progress testing
The video is the second module of the SPOC on "How to write items for measuring Student Progress".
The video introduces the steps involved in creating a large-scale progress testing program, which has specific requirements that goes beyond the requirements in normal multiple choice test situations, as the progress tests shall measure growth in knowledge over time of both high and low performing students over time and maybe even between schools, as in the VetRepos Collaboration. One of the critical steps is therefore establishing a quality assurance system for safeguarding test item quality and validity.
The video covers the first two steps involved in progress testing: Writing a series of test items covering the subject areas of the curriculum to be tested, and qualitative evaluation of items known to the item writers and peers. Specific attention is given to writing unambiguous and clear language items suitable for objective computerized scoring and statistical analysis on the same scale.
Additionally, the video presents specific item formats that are suitable for subsequent psychometric analysis.
The next and last video in first module of the SPOC will explain some of the issues an item writer must consider before starting to produce items.
Further reading
- V. Albano, D. Firmani, L. Laura, A. L. Paoletti and I. Torrente, "Managing Large Multiple-choice Test Items Repositories," 2022 26th International Conference Information Visualisation (IV), Vienna, Austria, 2022, pp. 275-279, doi: 10.1109/IV56949.2022.00054.
-
Denny, Paul & Luxton-Reilly, Andrew & Hamer, John & Purchase, Helen. (2009). Coverage of course topics in a student generated MCQ repository. 11-15. 10.1145/1562877.1562888.