Behavior Rating Inventory of Executive Function (BRIEF2): Analyzing and Interpreting Ratings from Multiple Raters Melissa A. Messer1, MHS, Jennifer A.

Slides:



Advertisements
Similar presentations
Psychometric Properties of a New Measure to Differentiate the Autism Spectrum from Schizoid Personality Disorder Traits Presented by Peter D. Marle, BA.
Advertisements

Peter K. Isquith, Robert M. Roth, & Gerard A. Gioia
The Relationship Between Preschool Executive Function Skills and Oral Narrative Skills By: Kathleen Trainor.
BRIEF®: Behavior Rating Inventory of Executive Function® Authors: Gerard A. Gioia, PhD, Peter K. Isquith, PhD, Steven C. Guy, PhD, and Lauren Kenworthy,
Patricia C. Post, Psy.D., Licensed Psychologist
Results Mealtime Behaviors Associated with Body Mass Index in Young Children With Autism Spectrum Disorders William R. Black MA 1,2, Cathleen Odar Stough.
Introduction Method  Evaluation of ability to provide social support yielded scores with good internal consistency reliability.  There was moderate agreement.
The Effects of Increased Cognitive Demands on the Written Discourse Ability of Young Adolescents Ashleigh Elaine Zumwalt Eastern Illinois University.
Long-term Outcomes of an Interdisciplinary Weight Management Clinic for Youth with Special Needs Meredith Dreyer Gillette PhD 1, 2, Cathleen Odar Stough.
The Relationship Between Executive Function and Language Abilities in Grade School Children By: Jacquelyn Liesen Faculty Mentors: Mrs. Jill Fahy & Dr.
Assessment: Understanding the Psycho-Educational Evaluation Elizabeth A. Rizzi, MA NYS Certified School Psychologist John Jay High School.
The Learning Behaviors Scale
Introduction The relationship between pediatric chronic pain and impairment is complex (Palermo & Chambers, 2005). Social consequences of pain are likely.
McMillan Educational Research: Fundamentals for the Consumer, 6e © 2012 Pearson Education, Inc. All rights reserved. Educational Research: Fundamentals.
ABSTRACT METHODS RESULTS CONCLUSION Background: Georgia rates the quality of early childcare learning centers using a tiered quality improvement system.
Behavioral and Emotional Correlates of ADHD in Children Tammy D. Barry, Ph.D. 1, Christopher T. Barry, Ph.D. 1, Beth H. Garland, M.A. 2, and Robert D.
Attention Deficit Disorder December 8, Attention Deficit Hyperactivity Disorder: DSM-IV-TR ADHD: combined type ADHD: combined type ADHD: predominantly.
Data were gathered from electronic medical records at an academic medical center. Subjects were included in the analyses if they were assessed using the.
Qatar Comprehensive Educational Assessment (QCEA) 2007: Summary of Results.
Ryoichi J. P. Noguchi, M.S., Michael M. Knepp, M.S., & Thomas H. Ollendick, Ph.D. INTRODUCTION METHOD  Studies of attention and memory have consistently.
Table 2: Correlation between age and readiness to change Table 1: T-test relating gender and readiness to change  It is estimated that 25% of children.
Health-Related Quality of Life in Adolescents with Neurofibromatosis-1: A Pattern of Similarity with Other Serious Chronic Illnesses Jessica M. Joseph.
Printed by The Aftercare and School Observation System: Characteristics of out-of-home contexts and young children’s behavior problems.
Behavior Rating Inventory of Executive Function BRIEF Behavior Rating Inventory of Executive Function BRIEF TM Gerard A. Gioia Peter K. Isquith Steven.
Self-Discrepancies and Depression: Abstract Reasoning Skills as a Moderator Erin N. Stevens, Christine Keeports, Nicole J. Holmberg, M. C. Lovejoy, Laura.
Results Baseline Differences Between Groups No significant differences were found between ethnic groups on baseline levels of Praise (F = 2.006, p>.05),
Whose Life is it Anyway? Proxy v. Self reported quality of life in Childhood Cancer Survivors Penney Upton.
BEHAVIOR ASSESSMENT SYSTEM FOR CHILDREN 2 ND EDITION (BASC-2) Misti Rohde EDUC 535 February 26, 2012.
Health Behavior Assessment
Leiter International Performance Scale – Revised
Measuring intervention effects in children with ASD: The use of specific and global outcome measures A. Nordahl-Hansen 1, S. Fletcher-Watson 2, H. McConachie.
School of Nursing Health Literacy Among Informal Caregivers of Persons With Memory Loss Judith A. Erlen, PhD, RN, FAAN; Jennifer H. Lingler, PhD, RN; Lisa.
The Role of Close Family Relationships in Predicting Multisystemic Therapy Outcome: An Investigation of Sex Differences ABSTRACT BACKGROUND: Multisystemic.
The authors would like to acknowledge the families at the Children’s Hospital of Wisconsin Jane P. Pettit Pain and Palliative Care Center. For more information,
General and Feeding Specific Behavior Problems in a Community Sample of Children Amy J. Majewski, Kathryn S. Holman & W. Hobart Davies University of Wisconsin-Milwaukee.
Hannah Holbrook BA 1, Kerry O’Loughlin BA 1, Robert Althoff MD, PhD 1, Heather Douglas-Palumberi MA 2, Joan Kaufman PhD 2, James Hudziak MD 1 1 Vermont.
OBJECTIVE INTRODUCTION Emergency Medicine Milestones: Longitudinal Interrater Agreement EM milestones were developed by EM experts for the Accreditation.
1 A Comparison of Motor Delays in Young Children: Autism Spectrum Disorder, Developmental Delay, and Developmental Concerns Beth Provost, Brian R. Lopez,
Study Population In , 1,154 Mexican origin youth (aged years) indicated which of 50 movies (randomly selected from a pool of 250 popular movies.
TEMPLATE DESIGN © Using Parental and Teacher's Ratings for Differential Screening of Taiwanese Children with Higher Functioning.
The Behavior Assessment System for Children (BASC)
: No disclosures #21634 Gender and ADHD in Ugandan Children: Comparison of Symptoms, Factor Structure, Prevalence, and Executive Functioning Matthew D.
Differences in SPECT Perfusion in Children and Adolescents with ADHD
Margaret Lombe, Ph.D. GSSW, Boston College
For more information contact:
Children’s Perceptions of a Brief Group Cognitive Behavioral Intervention: Preliminary data and clinical implications1 Robert D. Friedberg, Ph.D., ABPP.
Empathy in Medical Care Jessica Ogle (D
Executive functions in adults with developmental dyslexia
Facial Affect Recognition in Autism, ADHD and Typical Development
Kristen Davidson Alyssa Heggen Lauren Lafayette
Brotherson, S., Kranzler, B., & Zehnacker, G.
This research was supported by NIAAA K01AA
Introduction Methods Discussion Hypotheses Results References
CHAPTER 7: Developmental Assessment
Made for individuals ages birth to 89 years
Instrumentation: Reliability Measuring Caring in Nursing
האומץ והמאמץ – גם להקשיב וגם להתרכז
Using the MMPI-A to Identify Students with Emotional Disturbance
Introduction Results Conclusions Method
15.1 The Role of Statistics in the Research Process
The Resiliency Scale for Young Adults Revisited
Jennifer Greene, MSPH Psychological Assessment Resources, Inc.
Demographic Characteristics of the Sample DISCUSSION/CASE STUDY
Clinical Scales and Indexes
Profiles of Everyday Executive Function with the Behavior Rating of Executive Function, Second Edition (BRIEF2) Presented by Jennifer Greene, MSPH Melissa.
Observing Children: A Tool for Assessment
Parent Alliance Measure By: Richard R. Abidin & Timothy R. Konold
Neurodevelopmental Testing Services through CTSI
Interrater differences
Presentation transcript:

Behavior Rating Inventory of Executive Function (BRIEF2): Analyzing and Interpreting Ratings from Multiple Raters Melissa A. Messer1, MHS, Jennifer A. Greene1, MSPH, Peter K. Isquith2, PhD, Gerard Gioia3, PhD, Lauren Kenworthy, PhD, and Steven Guy, PhD Background Results The Behavior Rating Inventory of Executive Function, Second Edition (BRIEF2) is the first revision of the BRIEF, originally published in 2000 (Gioia, Isquith, Guy & Kenworthy, 2000). It is a parent, teacher and self-report rating scale designed to assess everyday behaviors associated with executive functions in the home and school environments. The BRIEF2 scales are combined to form three indexes (Behavior Regulation, Emotion Regulation, Cognitive Regulation) and one overall composite (Global Executive Composite). The majority of items are parallel across forms. Objective: We examined interrater reliability of the BRIEF2 among interrater dyad samples of both typically developing (TD) children and children with clinical and developmental disorders (i.e., autism spectrum disorder, attention-deficit hyperactivity disorder, learning disorder). The correlations between raters are moderate to strong for TD children and low to moderate for clinical groups. Parent/Parent, Parent/Teacher, and Parent/Self raters had the strongest correlations in the TD sample. Teacher/Teacher, Parent/Parent raters had moderate correlations in the clinical sample. The mean differences between BRIEF2 scores are relatively small. Effect sizes ranged from .03 to .21 in the typically developing sample and from .00 to .33 in the clinical sample, indicating very small differences between raters. For parent and teacher ratings, 53-59% of cases reported scores within 10 T-score points. As expected the agreement of the Parent–Parent sample was higher, with 67-76% of being within 10 T-score points. Agreement in the Teacher–Teacher sample was even higher, with 70-76% of cases bring within 10 T-score points of each other. Agreement within 10 T-score points for adolescents when compared to parents and teachers ratings was 59-63% and 52-59% of cases, respectively. Correlations between Dyad Scores Sample Pair BRI ERI CRI GEC Parent/Parent Clinical .63* .61* .57* .56* TD .75* .73* .88* .86* Teacher/Teacher .70** .52** .58** .62** .45** .27** .47** Parent/Teacher .32** .36** .30** .72** .60** Parent/Self-Report .33 .28* .35* .25* .62* .59* .74* .71* Teacher/Self-Report .24* .14* .20* .13* .51* .42* Mean Differences and Effect Sizes for Dyad Scores Sample Pair BRI ERI CRI GEC Mean Difference d Parent/Parent Clinical 1.77 .14 2.37 .18 1.53 .15 2.02 .20 TD .52 .13 .34 .04 .27 .03 .46 .05 Teacher/Teacher .39 .01 .00 1.22 1.20 .94 .10 1.14 .12 Parent/Teacher .75 3.34 3.12 .28 3.07 1.90 .21 2.18 .24 1.84 1.93 Parent/Self-Report .57 1.86 .16 3.58 .33 3.25 1.45 .99 .11 1.47 1.41 Teacher/Self-Report 2.57 3.21 .29 .23 2.62 .26 1.17 2.28 .25 1.76 .19 Methods Participants: Reliability was assessed within five dyads: Parent/Teacher, Parent/Self-Report, Teacher/Self-Report, Parent/Parent & Teacher/Teacher. Methods: Correlations, mean differences & effect sizes for each index were examined. Effect size, Cohen’s d, was calculated based on the mean difference and pooled standard deviation for each pair’s index scores In addition, percentages of these samples that obtained various T-Score differences on the Index scores and GEC score were calculated. Parent/ Parent Teacher/ Teacher Self-Report C TD n 287 149 583 115 1,426 632 458 472 343 372 Gender Male 64.8 46.3 71.2 50.4 68.5 47.2 59.0 48.3 56.7 47.3 Female 35.2 53.7 28.8 49.6 31.5 52.8 41.0 51.7 41.3 52.7 Age (years) M 11.4 10.8 12.4 13.9 11.0 11.5 14.7 14.6 14.4 SD 3.4 3.8 3.2 3.0 4.0 2.1 2.3 Note. C = clinical sample; TD = typically developing sample Percentages of Dyad Scores within 10 T-Score Points (Clinical Samples only) Sample Pair BRI ERI CRI GEC Parent/Parent 68% 67% 75% 76% Teacher/Teacher 72% 73% 70% Parent/Teacher 55% 53% 59% 57% Parent/Self-Report 63% 62% Teacher/Self-Report 52% BRIEF2 Indexes/Composite Behavior Regulation Index (BRI) Regulate and monitor behavior effectively, reflecting inhibitory control and self-monitoring. Emotion Regulation Index (ERI) Regulate emotional responses, adapt to changes and shift set appropriately reflecting the Shift and Emotional Control scales. Cognitive Regulation Index (CRI) Control and manage cognitive processes; to initiate, plan, organize and monitor problem solve effectively, holding goals and plans in working memory. Global Executive Composite (GEC) Overall summary incorporating all aspects of executive functioning captured on the BRIEF-2. Conclusions Pairs of raters with similar perspectives, namely, Parent–Parent and Teacher–Teacher, tend to be correlated more highly than raters who see the child from different perspectives. The lowest correlations were seen between adolescent and either parents or teachers. Gathering multiple perspectives in the assessment of a child’s functioning provides a more comprehensive set of data. An interpretive strategy that includes comparison of dyads or triads of raters’ views is desirable. 1Psychological Assessment Resources; 2Geisel School of Medicine at Dartmouth College; 3Children’s National Medical Center