Authors: Gebhardt, Markus
DeVries, Jeffrey M.
Jungjohann, Jana
Casale, Gino
Gegenfurtner, Andreas
Kuhn, Jörg-Tobias
Title: Measurement invariance of a direct behavior rating multi item scale across occasions
Language (ISO): en
Abstract: Direct Behavior Rating (DBR) as a behavioral progress monitoring tool can be designed as longitudinal assessment with only short intervals between measurement points. The reliability of these instruments has been mostly evaluated in observational studies with small samples based on generalizability theory. However, for a standardized use in the pedagogical field, a larger and broader sample is required in order to assess measurement invariance between different participant groups and over time. Therefore, we constructed a DBR, the Questionnaire for Monitoring Behavior in Schools (QMBS) with multiple items to measure the occurrence of specific externalizing and internalizing student classroom behaviors on a Likert scale (1 = never to 7 = always). In a pilot study, two trained raters observed 16 primary education students and rated the student behavior over all items with a satisfactory reliability. In the main study, 108 regular primary school students, 97 regular secondary students, and 14 students in a clinical setting were rated daily over one week (five measurement points). Item response theory (IRT) analyses confirmed the technical adequacy of the instrument and latent growth models demonstrated the instrument’s stability over time. Further development of the instrument and study designs to implement DBRs is discussed.
Subject Headings: Direct behavior rating
Sensitivity over time
Progress monitoring
Issue Date: 2019-02-04
Rights link:
Appears in Collections:Entwicklung und Erforschung inklusiver Bildungsprozesse

Files in This Item:
File Description SizeFormat 
socsci-08-00046-v2.pdf604.76 kBAdobe PDFView/Open

This item is protected by original copyright

This item is licensed under a Creative Commons License Creative Commons