Presentation on theme: "Initial validation of the Schedule of Growing Skills (SGS) Margiad Elen Williams Bangor University."— Presentation transcript:
Initial validation of the Schedule of Growing Skills (SGS) Margiad Elen Williams Bangor University
Content Background Validation process Step one Step two Conclusions
Background Screening tools are used to identify children with possible developmental delay to enable subsequent more rigorous assessment. Quick, inexpensive, and easy to use. Should be as accurate as possible.
American Academy for Pediatrics (2006) Published recommended psychometric criteria that all screening tools should meet. Sensitivity – proportion of correctly identified children in need of further assessment. Specificity – proportion of correctly identified children who are developing typically. Both need to be at least 70%.
The SGS in Wales Welsh Assembly Government introduced Flying Start (FS) Initiative. SGS chosen as the developmental screening tool to evaluate FS Initiative. Problems with scoring identified during IY Toddler trial (Hutchings et al., 2011).
Problems with SGS scoring Windows of assessment vary. Score highest item within scale regardless of performance on other items. Cannot compare between groups or across time. Problems can be solved by developing way of scoring to yield a Developmental Quotient (DQ) score.
Aims To validate both the original and new DQ way of scoring the SGS. Two step validation process. Use of two data sets, the RCT of the IY Toddler programme and MRes project comparing the SGS and GMDS.
Step one Aim 1: Estimate appropriate cut- off for new SGS scoring method Aim 2: Determine concurrent validity of both SGS scoring methods against GMDS Step two Aim 1: Determine concurrent validity of both SGS scoring methods against Ages and Stages Questionnaire (ASQ)
Step one: Sample & Measures Participants 39 children Mean age 31 months 61% male Measures Griffiths Mental Development Scales (GMDS) Schedule of Growing Skills (SGS)
Step two: Sample & Measures Participants 94 children Mean age 22 months 61% male Measures Ages and Stages Questionnaire (ASQ) Schedule of Growing Skills (SGS)
Subscale comparisons Griffiths Mental Development Scales (GMDS) Schedule of Growing Skills (SGS) Ages and Stages Questionnaire (ASQ) LocomotorGross motor Performance & Eye-Hand Coordination (fine motor) Manipulative & Visual (fine motor) Fine motor LanguageHearing, Speech, & Language Communication Personal-SocialInteractive & Self-care
Results: Step one SGS cut-offAUCSensitivitySpecificity DQ < 90.79490.8367.88 DQ < 85.77974.1881.55 DQ < 80.78965.8391.90 Most accurate cut-off is DQ < 85. Both sensitivity and specificity levels > 70% Aim 1: Establishing cut-off point
Results: Step one Aim 2: Concurrent validity with GMDS Development area SGS scoringSensitivity (%) Specificity (%) Over- referrals (%) Under- referrals (%) LocomotorOriginal16.67100012.80 New (DQ < 85)83.3351.5241.022.56 Personal-SocialOriginal010007.69 New (DQ < 85)66.6710002.56 LanguageOriginal20100010.26 New (DQ < 85)8094.125.132.56 Fine motorOriginal010007.69 New (DQ < 85)66.6780.5617.952.56 OverallOriginal9.1710009.61 New (DQ < 85)74.1781.5516.032.56
Results: Step two Aim 1: Concurrent validity with ASQ Development area SGS scoringSensitivity (%) Specificity (%) Over- referrals (%) Under- referrals (%) LocomotorOriginal1098.811.069.57 New (DQ < 85)7092.866.383.19 LanguageOriginal5093.026.384.26 New (DQ < 85)7583.7214.892.13 Fine motorOriginal26.6792.416.3811.70 New (DQ < 85)66.6777.2219.155.32 OverallOriginal28.8994.754.618.51 New (DQ < 85)70.5684.6013.473.55