Evaluation of two methods for estimating item response theory parameters when assessing differential item functioning
Article Abstract:
Recent legal developments appear to sanction the use of psychometrically unsound procedures for examining differential item functioning (DIF) on standardized tests. More appropriate approaches involve the use of item response theory (IRT). However, many IRT-based DIF studies have used Lord's (1968) joint maximum likelihood procedure, which can lead to incorrect and misleading results. A Monte Carlo simulation was conducted to evaluate the effectiveness of two other methods of parameter estimation: marginal maximum likelihood estimation and Bayes modal estimation. Sample size and data dimensionality were manipulated in the simulation. Results indicated that both estimation methods (a) provided more accurate parameter estimates and less inflated Type 1 error rates than joint maximum likelihood, (b) were robust to multidimensionality, and (c) produced more accurate parameters estimates and higher rates of identifying DIF with larger samples. (Reprinted by permission of the publisher.)
Publication Name: Journal of Applied Psychology
Subject: Social sciences
ISSN: 0021-9010
Year: 1990
User Contributions:
Comment about this article or add new information about this topic:
Identification of unique cultural response patterns by means of item response theory
Article Abstract:
An item response theory (IRT) analysis was used to identify cultural response patterns by comparing single-culture groups with a multicultural composite. A survey designed to measure attitudes toward mental health was administered in their native languages to American, German, and French working, retired, and student teachers. Item characteristics curves (ICCs) for each national group were compared with ICCs generated by a composite reference containing all three cultural groups, thus providing an omnicultural reference point. Items that exhibited differential item functioning (DIF), that is, items with dissimilar ICCs for the composite reference and focal groups, were indicative of unique cultural response patterns to the attitude survey items. The advantages and disadvantages of this method in an IRT analysis are discussed. (Reprinted by permission of the publisher.)
Publication Name: Journal of Applied Psychology
Subject: Social sciences
ISSN: 0021-9010
Year: 1992
User Contributions:
Comment about this article or add new information about this topic:
Differential item functioning: implications for test translations
Article Abstract:
Statistical methods based on item response theory (IRT) were used to bidirectionally evaluate the measurement equivalence of translated American and German intelligence tests. Items that displayed differential item functioning (DIF) were identified, and content analysis was used to determine probable sources of DIF, either cultural or linguistic. The benefits of using an IRT analysis in examining the fidelity of translated tests are described. In addition, the influence of cultural differences on test translations and the use of DIF items to elucidate cultural differences are discussed. (Reprinted by permission of the publisher.)
Publication Name: Journal of Applied Psychology
Subject: Social sciences
ISSN: 0021-9010
Year: 1989
User Contributions:
Comment about this article or add new information about this topic:
- Abstracts: Survival versus traditional methodologies for studying employee turnover: differences, divergences and directions for future research
- Abstracts: Effects of incentive size and timing on response rates to a follow-up wave of a longitudinal mailed survey. Effects of an introductory letter on response rates to a teen/parent telephone health survey
- Abstracts: The Planar Maximal Covering Location Problem. Asymmetric entrant location with a discrete consumer distribution: spatial price discrimination versus mill pricing
- Abstracts: Decomposition of Ex Ante State Model Forecasting Errors. A Note on Regional Investment Functions. Developing countries and environmental protection: the effects of ex ante versus ex post contracting
- Abstracts: Beyond imitation: complex behavioral and affective linkages resulting from exposure to leadership training models