INTRODUCTION This study involved the compilation and evaluation of the psychometric properties of 11 currently available single word articulation tests.

Slides:



Advertisements
Similar presentations
Standardized Scales.
Advertisements

ASSESSING RESPONSIVENESS OF HEALTH MEASUREMENTS. Link validity & reliability testing to purpose of the measure Some examples: In a diagnostic instrument,
Merry Christmas and Happy New Year 2007 The Beery- Buktenica Developmental Test of Visual-Motor Integration Present by Asst. Prof. Dr. Nuntanee Satiansukpong.
Part II Sigma Freud & Descriptive Statistics
Part II Sigma Freud & Descriptive Statistics
General Information --- What is the purpose of the test? For what population is the designed? Is this population relevant to the people who will take your.
NOVA Comprehensive Perspectives on Child Speech Development and Disorders Chapter 20 Diagnostic Guidelines Amy Glaspey 1.
+ Evidence Based Practice University of Utah Presented by Will Backner December 2009 Training School Psychologists to be Experts in Evidence Based Practices.
BASIC TERMINOLOGY n Test n Measurement n Evaluation.
Measurement: Reliability and Validity For a measure to be useful, it must be both reliable and valid Reliable = consistent in producing the same results.
Presented by: Mohsen Saberi and Sadiq Omarmeli  Language testing has improved parallel to advances in technology.  Two basic questions in testing;
FOUNDATIONS OF NURSING RESEARCH Sixth Edition CHAPTER Copyright ©2012 by Pearson Education, Inc. All rights reserved. Foundations of Nursing Research,
Pacifier Use and Speech Sound Development Tamara Nagoda, M.S. 1 & Peter Flipsen Jr., Ph.D. 2 1 Idaho State University, Meridian, ID 2 Pacific University,
Lesson Thirteen Standardized Test. Yuan 2 Contents Components of a Standardized test Reasons for the Name “Standardized” Reasons for Using a Standardized.
Classroom Assessment A Practical Guide for Educators by Craig A
Review of three tests of children’s narrative ability [Poster presented at Narratives, Intervention, and Literacy conference, Paris, France, Sept. 2012]
Author: Sabrina Hinton. Year and Publisher: American Guidance Service.
Measurement Concepts & Interpretation. Scores on tests can be interpreted: By comparing a client to a peer in the norm group to determine how different.
Measurement and Data Quality
But What Does It All Mean? Key Concepts for Getting the Most Out of Your Assessments Emily Moiduddin.
Audit Evidence Advanced Auditing Lecture 3 Dr. Mohamed A. Hamada.
Reading Assessments for Elementary Schools Tracey E. Hall Center for Applied Special Technology Marley W. Watkins Pennsylvania State University Frank.
Kaizen–What Can I Do To Improve My Program? F. Jay Breyer, Ph.D. Presented at the 2005 CLEAR Annual Conference September Phoenix,
Psychometric Characteristics of the Pain Treatment Satisfaction Scale Robyn L. Walker 1, Michael E. Clark 1,2, Ronald J. Gironda 1,2 1 James A. Haley Veteran’s.
Phonological Disorders in Spanish Speaking Children: Accounting for Mexican Dialect Karen Wing, M.S., & Peter Flipsen Jr., Ph.D. Idaho State University.
Measuring and Assessing Severity of Involvement for Children with SSD Peter Flipsen Jr., PhD, S-LP(C), CCC-SLP Professor of Speech-Language Pathology Idaho.
Educational Research: Competencies for Analysis and Application, 9 th edition. Gay, Mills, & Airasian © 2009 Pearson Education, Inc. All rights reserved.
Copyright © 2012 Wolters Kluwer Health | Lippincott Williams & Wilkins Chapter 14 Measurement and Data Quality.
LECTURE 06B BEGINS HERE THIS IS WHERE MATERIAL FOR EXAM 3 BEGINS.
Standardization and Test Development Nisrin Alqatarneh MSc. Occupational therapy.
Final Study Guide Research Design. Experimental Research.
Authors of manuscripts stemming from either platform and poster presentations are invited to submit an article for publication in the CAC Supplement that.
The Analysis of the quality of learning achievement of the students enrolled in Introduction to Programming with Visual Basic 2010 Present By Thitima Chuangchai.
Diagnostics Mathematics Assessments: Main Ideas  Now typically assess the knowledge and skill on the subsets of the 10 standards specified by the National.
Bankson-Bernthal Test of Phonology
Power Point and Syllabus h3443.html.
EVIDENCE ABOUT DIAGNOSTIC TESTS Min H. Huang, PT, PhD, NCS.
Clinical Assessment of Articulation and Phonology
Chapter 5 Informal Assessment: Progress Monitoring.
Introduction Gathering Information Observation Interviewing Norm Referenced Tools Authentic Assessment Characteristics of Authentic Assessment – 7M’s Validity.
PORTFOLIO ASSESSMENT OVERVIEW Introduction  Alternative and performance-based assessment  Characteristics of performance-based assessment  Portfolio.
Evaluating Assessment for the NRS Evaluating Assessments for the NRS American Institutes for Research February 2005.
An Innovative Approach to Fair Evaluations for People with Cognitive Disabilities.
Copyright © 2008 Wolters Kluwer Health | Lippincott Williams & Wilkins Chapter 17 Assessing Measurement Quality in Quantitative Studies.
Validity and Item Analysis Chapter 4.  Concerns what instrument measures and how well it does so  Not something instrument “has” or “does not have”
Abstract CHADIS-DSM, a web-based questionnaire for making provisional DSM-PC diagnoses, was administered to 85 caregivers of inner city children aged 3-12.
DISCUSSION These new measures may have some clinical utility such as possible indices of severity (cf. Flipsen, Hammer, & Yost, 2005). PMV may be of particular.
Assessing Responsiveness of Health Measurements Ian McDowell, INTA, Santiago, March 20, 2001.
BEHAVIOR ASSESSMENT SYSTEM FOR CHILDREN 2 ND EDITION (BASC-2) Misti Rohde EDUC 535 February 26, 2012.
Technical Adequacy of Tests Dr. Julie Esparza Brown SPED 512: Diagnostic Assessment.
SECOND EDITION Chapter 5 Standardized Measurement and Assessment
Chapter 6 - Standardized Measurement and Assessment
Test of Early Reading Ability-3 (TERA-3) By: Jenna Ferrara.
DISCUSSION As the children gained experience with their implants, their words became longer and closer to the adult target. They also attempted longer.
S519: Evaluation of Information Systems Social Statistics Inferential Statistics Chapter 16: reliability and validity.
Measurement and Scaling Concepts
ESTABLISHING RELIABILITY AND VALIDITY OF RESEARCH TOOLS Prof. HCL Rawat Principal UCON,BFUHS Faridkot.
STAR Reading. Purpose Periodic progress monitoring assessment Quick and accurate estimates of reading comprehension Assessment of reading relative to.
Early Literacy Screening: Comparing PALS-K with AIMSweb and STAR
VALIDITY by Barli Tambunan/
The Development of Language-Specific Speech Norms for Sri Lankan Tamil
Copyright © American Speech-Language-Hearing Association
Test Design & Construction
Copyright © American Speech-Language-Hearing Association
Speech and Language Diagnostic Report Samples
This teaching material has been made freely available by the KEMRI-Wellcome Trust (Kilifi, Kenya). You can freely download,
Made for individuals ages 6-0 and years
© The Author(s) Published by Science and Education Publishing.
The Brief Mood Introspection Scale (BMIS) 30 Years Later: Norms and Validity Evidence from a Meta-Analysis . Rachael M. Cavallaro, Victoria M. Bryan.
Assessment Chapter 3.
Presentation transcript:

INTRODUCTION This study involved the compilation and evaluation of the psychometric properties of 11 currently available single word articulation tests. The goal was to assist busy clinicians with test selection. METHOD The two authors independently evaluated the test manuals and forms and then reached consensus. The following tests were evaluated: AAPS-3 - Arizona Articulation Proficiency Scale (Third Edition; 2000). ALPHA - Assessment Link between Phonology and Articulation (2000?). BBTOP - Bankson-Bernthal Test of Phonology (1990). CAAP- Clinical Assessment of Articulation and Phonology (2002). DEAP-A - Diagnostic Evaluation of Articulation and Phonology (American Edition; 2006). GFTA-2 - Goldman-Fristoe Test of Articulation (Second Edition; 2000). HAPP-3 - Hodson Assessment of Phonological Patterns (Third Edition; 2004). LAT - Linguisystems Articulation Test (2010). PAT-3 - Photo Articulation Test (Third Edition; 1997). SHAPE - Smit-Hand Articulation and Phonology Evaluation (1996). SPAT-D - Structured Photographic Articulation Test Featuring Dudsbury (2001). Psychometric Characteristics of Single Word Articulation Tests Peter Flipsen Jr., Ph.D. 1 & Diane Ogiela, Ph.D. 2 1 Pacific University, Forest Grove, OR 2 Idaho State University, Meridian, ID ASHA Convention, 2013 Chicago, IL DISCUSSION Several tests excluded children with SSDs from the normative sample yielding a somewhat “purified” comparison group. This presumes that “normal” and “disorder” are unique categories rather than part of a continuum. None of the tests provided any evidence of predictive validity (as defined by McCauley & Swisher, 1984). Is this criterion an unreasonable burden (see AAPS-3 manual)? Long-term studies of outcomes prior to publishing are not commercially practical. They may also require withholding treatment. Diagnostic accuracy is related to predictive validity and may be a more appropriate criterion. Most of the tests (7/11) presented diagnostic accuracy findings but used group differences; only the DEAP-A also included specific findings for sensitivity and specificity. McCauley & Swisher (1984) suggest that correlation values for test-retest and inter-examiner reliability should be 0.90 or higher. The current study only determined whether should correlations were reported. None of the tests reviewed met all 13 criteria, but all met at least six. Four tests met 10 or more criteria. None of the five articulation tests reviewed by McCauley & Swisher (1984) met even 4/10 criteria suggesting that our tests have improved since then. REFERENCES McCauley, R.J., & Swisher, L. (1984). Psychometric review of language and articulation tests for preschool children. Journal of Speech and Hearing Disorders, 49, AAPS-3ALPHABBTOPCAAPDEAP-AGFTA-2HAPP-3LATPAT-3SHAPESPAT-D Clearly defined standardization sample? √ √ √√√√√√√√√ Adequate subgroup size (n > 100)? 1 √ √ 2 √ 3 √ 4 √ Did norming sample include those with SSD??√√√√√ 5 ? Item analysis used to select final stimuli?√√√√ Provides Means and SDs for subgroups? √ √√√√√√√√√√ Standard error of measurement data provided? √ √√√√√√√ Evidence of concurrent validity presented? √ √√√√√ Evidence of predictive validity presented? Test-retest reliability reported? √ √√√√√√√√ Inter-examiner reliability reported?√√√√√√√√√ Detailed administration instructions provided? √ √√√√√√√√√√ Examiner qualifications specified? √ √√√√√√√√√ Diagnostic accuracy data reported?√√√ 6 √√√√ TOTAL CRITERIA MET (of 13 possible) RESULTS: Basic Analysis Does each test meet the basic criteria for standardized tests as set forth by McCauley & Swisher (1984) along with some additional criteria (highlighted in red)? RESULTS: Analyses Available Does each test allow for systematic analysis of both traditional (initial, medial, final position) accuracy and phonological patterns (processes)? Did it include formal analysis of vowels? Does it examine multisyllabic words? AAPS-3ALPHABBTOPCAAPDEAP-AGFTA-2HAPP-3LATPAT-3SHAPESPAT-D Traditional – consonants√ √√√√√√√√√√ Traditional – vowels√ √√ 3 Patterns – typical √√√√√√√ Patterns – atypical 1 √√√ Multisyllabic words 2 √√ 4 √√√ √ = meets criterion. ? = Not specifically mentioned. 1 For actual comparison groups in normative tables. 2 For 11/12 subgroups. 3 Only for 6/10 subgroups. 4 Only for 15/22 subgroups. 5 Only for about half of the sample. 6 Includes predictive power and sensitivity/specificity findings in addition to group differences. 1 As defined by the test authors. 2 Four or more words containing at least three syllables. 3 Not included in the score calculation. 4 Only on two subtests.