3.3 Test theory and item analysis

The last video of 10 videos in this SPOC on "Writing test items for measuring student progress" presents the differences between the two main theoretical models in testing, classical test theory and modern test theory, with a focus on the Rasch model, including the connection between the ability of students and the difficulty of the test items.

The speaker begins with defining what a test model is and describing its data elements. An example of a classical simple item analysis i giving.

Next, the video describes the basic difference between the classical test theory, which focus on explaining the total test score, and the Rasch model, which is a probabilistic model with two variables, the ability of the student and the difficulty of the item. Item response analysis (IRT) is described, including explanation of the item characteristic curve (ICC) and how it indicates the probability for correct response given the student's ability. The video then give examples of distractor analysis of both well-functioning and not so well functioning test items.

The video ends with a summary of the precondition for the Rasch model, and it highlights the importance of ensuring that the data fits the model to ensure that the test measures the same construct as the other items.

3.3 Test theory and item analysis

Further reading