Models for analysis of rater effect in educational measurement Cover Image

Modele analizy efektu oceniającego w pomiarze edukacyjnym
Models for analysis of rater effect in educational measurement

Author(s): Filip Kulon
Subject(s): Education
Published by: Instytut Badań Edukacyjnych
Keywords: educational measurement; rater effect; scoring; item response theory; IRT

Summary/Abstract: The article is the result of a search for an optimal model of data analysis in a study on scoring comparability and rater effect in upper secondary school leaving examination in Polish language and mathematics. The first part briefly outlines the theory on rater effect. Mainly the measurement aspect is presented, the psychological bases of the scoring process are not discussed. In the second part selected models of rater effect analysis are described. Amongst them, the hierarchical rater model with signal detection theory is considered as covering the broadest range of different types of rater effect. This model was used in simulations to check its usefulness for data analysis of upper secondary school leaving examination in Poland.

  • Issue Year: 128/2014
  • Issue No: 3
  • Page Range: 95-111
  • Page Count: 17
  • Language: Polish