Comparison of Mantel–Haenszel test with IRT procedures for DIF detection and effect size estimation for dichotomous items Cover Image

Comparison of Mantel–Haenszel test with IRT procedures for DIF detection and effect size estimation for dichotomous items
Comparison of Mantel–Haenszel test with IRT procedures for DIF detection and effect size estimation for dichotomous items

Author(s): Bartosz Kondratek, Magdalena Grudniewska
Subject(s): Education
Published by: Instytut Badań Edukacyjnych
Keywords: differential item functioning; Mantel–Haenszel test; item response theory

Summary/Abstract: The article compares two methods used to detect differential item functioning (DIF) of dichotomously scored items: a nonparametric solution based on the Mantel–Haenszel procedure (MH) and a parametric IRT approach with a likelihood ratio test. A Monte Carlo experiment was performed in order to evaluate performance of both statistics in various conditions of DIF uniformity. Results confirmed the theoretical prediction that the MH test has greater statistical power in detecting uniform DIF than the likelihood ratio test and less power than the LR test in cases of non-uniform DIF. Apart of examining statistical power of the test, specific measures of DIF effect size were compared: MH D–DIF and three measures of P–DIF expressed on the item easiness scale.

  • Issue Year: 130/2014
  • Issue No: 5
  • Page Range: 92-111
  • Page Count: 20
  • Language: English