Abstract

© 2016 CRES.The Devereux Student Strengths Assessment Mini efficiently monitors the growth of Social-Emotional Competence in the routine implementation of Social Emotional Learning programs. The DESSAMini is used to assess approximately half a million children around the world. Since behavior rating scales can have 'rater bias', this paper examines rater characteristics that contribute to DESSA-Mini ratings. Rater characteristics and DESSA-Mini ratings were collected from elementary school classroom teachers implementing TOOLBOX in a racially/ethnically diverse California school district. Teachers rated 1,676 students, who scored similarly to a national reference group. Multilevel modeling analysis showed that only 16% of variance in DESSA-mini ratings was attributable to raters. Relationships between teacher characteristics and ratings were estimated to examine rater variance. Collectively, four characteristics of teachers accounted for bias in teacher-generated DESSA scores, leaving only 10% of the variance unexplained. Identified sources of 'rater bias' can be controlled for in research and addressed through thoughtful program selection, training, and implementation.