1. Actions Speak Louder than Words: An Analysis of ABCT Poster Methodology Procedure Data was collected from the following poster sessions: 1a, 1b, 5a, 8a, 9a, 10a, 10b, Child and Adolescent Anxiety SIG Investigators collected poster handouts during the poster sessions Posters were randomized among raters Investigators independently rated handouts using the PCF 20% of the posters were double coded to assess for interrater reliability. Adequate interrater reliability was attained for topic and methodology. Study Aim To evaluate methods used in studies presented at the 37th annual ABCT meeting. INTRODUCTION Chad S. Brice, B.A.; Andrea M. Jones, B.A.; Chelsea M. Ale, M.S.; Christopher F. Drescher; & Tracy L. Morris, Ph.D. West Virginia University For questions please contact Chad.Brice@mail.wvu.edu METHOD METHOD, cont. DISCUSSIONRESULTS Sample Observed 94 anxiety disorder posters presented at the 2007 ABCT conference Inclusion criteria: Posters were selected from anxiety related poster sessions (e.g., GAD and Panic, Social Anxiety and Body Dysmorphic Disorder, Adult Anxiety, Child Anxiety) Exclusion Criteria: Posters assessing OCD and PTSD were excluded ABCT was originally founded in 1966 as the Association for the Advancement of Behavioral Therapies (AABT) and then became the Association for the Advancement of Behavioral Therapy in 1967. While cognitive therapy incorporates learning theory just as behavior therapy, AABT’s name was changed in 2005 to explicitly include cognitive therapy. The name change was also made to promote increases in membership. As an organization ABCT seeks to establish behavior therapy as an empirical science by promoting the development and dissemination of empirically based, behavioral psychotherapy and assessment (ABCT, 2003). Historically, the science of human behavior has been grounded in research emphasizing the observation of behavior. Indirect methods such as self- report can be useful research tools, but they have been shown to have limited reliability and validity. With the recent expansion of the organization’s membership, it is important to evaluate the use of empirical methods in psychotherapy and assessment research. Method by Topic EtiologyTreatment Assessment n=64 % n= 16%n= 14% Paper & pencil self-report 6195.3%1487.5%14100.0% Interview self-report 1421.9% 637.5%4 28.6% Other informant report 2 3.1%---- Behavioral Observation -- 212.5%-- Behavioral Performance Task 1625.0% 4 1 7.1% Physiological Measure 1 1.6% 1 6.3%-- Other 1 1.6%---- Measures Poster Classification Form (PCF) was used to assess the following: Topic:  Assessment - measure development, factor analysis, psychometric properties, validation  Treatment - clinical trials, treatment research  Etiology - of or pertaining to theory  Other RESULTS Implications Recently self-report measures alone dominate the research landscape, despite the incremental validity of multi-method assessment and the ecological validity of behavioral observations and physiology measures. Self-report measures are less expensive and less time-consuming than other measures but at what cost to the quality of our research findings. Clinical interviews are the second most utilized method of assessment but also heavily rely on the self-report of the participant. Attempts to manage impressions are less toxic in behavioral or physiological measures. Limitations The present study sampled only research related to anxiety disorders and is not representative of the field as a whole. Only posters that provided handouts were included in the study so that interrater reliability could be assessed. There is not a hypothesized, systematic difference between researchers who do and do not provide paper handouts of their research, but differences cannot be assessed at this time. Future Directions The field of anxiety research should continue to examine its research methods and replicate single-method studies to determine whether different methods provide concurrent validity. Other specialty areas within psychology should also assess their utility of research methods to determine whether single-method, self-report approaches are dominant across research areas. Rate of Methods Use Measures, cont. Poster Classification Form (PCF) cont. Terminology:  Behavioral  Cognitive Behavioral  Cognitive  Psychodynamic  Other Method:  Behavioral Observation - naturalistic observation with no interference nor set task  Behavioral Performance Task - observation of performance in a set activity  Self-Report - pencil/paper, Interview  Other Informant Report - parent, teacher, etc; pencil/paper or interview  Physiological Measures  Other