Differential item functioning analysis of Likert scales: an overview and demonstration of rating scale tree model
Loading...
Date
2025-01-06
Journal Title
Journal ISSN
Volume Title
Publisher
Alternative Title(s)
Abstract
An important psychometric property in educational and psychological testing is differential item functioning (DIF), assessing whether different subgroups respond differently to particular items within a scale, despite having the same overall ability level. In fact, DIF occurs when respondents with the same underlying trait level have different probabilities of selecting specific response categories, depending on their subgroup membership. This study aims to demonstrate the usefulness of rating scale tree (RStree) model in detecting DIF of Likert-type scales across age and gender in social sciences. Compared to the conventional DIF methods, a priori specification of groups for detecting DIF is not required in the RStree model. The study used item responses of 721 English as a foreign language (EFL) students to a cognitive test anxiety scale. The analysis of the RStree model generated three non-predefined nodes, with slight variations in item difficulties. Four items of the scale were flagged as DIF items. Results showed that age does not have any impact on the performance of respondents, whereas gender has a role in generating DIF in test anxiety. The findings also indicated the effectiveness of the RStree model in reflecting the underlying interaction between the covariates and the scale items.
Description
Table of contents
Keywords
Likert-type scales, Differential item functioning, Rating scale tree model, Cognitive test anxiety, Gender
Subjects based on RSWK
Prüfungsangst, Messung, Likert-Skala