This is the third and last video of the first teaching module of the SPOC on "How to write items for measuring Student Progress".

The video discusses issues that item writers should consider before beginning to write test items. These include test blueprinting, concepts of content, face and construct validity, taxonomic levels to be addressed in the items, writing items for high stakes and low stakes tests, and the use of unambiguous and simple wording.

The speaker explains that blueprinting is necessary for selecting learning goals to address in a specific test and ensuring adequate content validity. The content validity of a test refers to how well the test items cover the content or the learning goals of the subject areas addressed by the test. An aspect of content validity is the so-called face validity, which indicates to what extent a test intuitively appears to be valid and to cover the concepts that it strives to cover, which is important in voluntary tests for getting students to engage. The speaker also discusses the taxonomic complexity of test items and how it can be raised by using the item vignette to describe a specific context for the following question or questions.

Finally, the speaker emphasizes the importance of qualitative review of test items and psychometrical analysis of test responses to ensure high construct validity, which is crucial in large-scale longitudinal testing.

Further reading

Item writing:
Haladyna, T. M., Downing, S. M., & Rodriguez, M. C. (2002). A Review of Multiple-Choice Item-Writing Guidelines for Classroom Assessment. Applied Measurement in Education, 15(3), 309–333. https://doi.org/10.1207/S15324818AME1503_5
Blueprinting:
Raymond, M. R., & Grande, J. P. (2019). A practical guide to test blueprinting. Medical Teacher, 41(8), 854–861. https://doi.org/10.1080/0142159X.2019.1595556
Reliability and Validity:
Bannigan, K., & Watson, R. (2009). Reliability and validity in a nutshell. Journal of Clinical Nursing, 18(23), 3237–3243. https://doi.org/10.1111/J.1365-2702.2009.02939.X