1. Early Childhood Outcomes Center Orientation for New Outcomes Conference Participants Kathy Hebbeler Lynne Kahn The Early Childhood Outcomes (ECO) Center

2. Early Childhood Outcomes Center 2 What We Will Cover  The three child outcomes  The 5 progress categories  Approaches to child outcomes  Family assessment tools  Common challenges

3. Early Childhood Outcomes Center 3 Goal of Early Intervention “…To enable young children to be active and successful participants during the early childhood years and in the future in a variety of settings – in their homes with their families, in child care, in preschool or school programs, and in the community.” (from Early Childhood Outcomes Center, http://www.fpg.unc.edu/~eco/pdfs/eco_outcomes_4-13-05.pdf)

4. Early Childhood Outcomes Center 4 Understanding the Three Child Outcomes

5. Early Childhood Outcomes Center 5 Three Child Outcomes Children have positive social-emotional skills (including social relationships) Children acquire and use knowledge and skills (including early language/communication [and early literacy]) Children use appropriate behaviors to meet their needs

6. Early Childhood Outcomes Center 6 Outcomes Are Functional Functional outcomes: Refer to things that are meaningful to the child in the context of everyday living Refer to an integrated series of behaviors or skills that allow the child to achieve the important everyday goals

7. Early Childhood Outcomes Center 7 Functional Outcomes are NOT A single behavior The sum of a series of discrete behaviors or splinter skills such as….. *Knows 10 words*Pincer grasp (picks up a raisin) *Smiles at mom *Goes up and down stairs with one foot on each stair *Stacks 3 blocks

8. Early Childhood Outcomes Center 8 Functional Outcomes Not domains-based, not separating child development into discrete areas (communication, gross motor, etc.) Refer to behaviors that integrate skills across domains Can involve multiple domains Emphasize how the child is able to carry out meaningful behaviors in a meaningful context

9. Early Childhood Outcomes Center 9 Thinking Functionally (within age-expected bounds) Isolated skill Knows how to imitate a gesture when prompted by others Uses finger in pointing motion Uses 2-word utterances Functional skill Watches what a peer says or does and incorporates it into his/her own play Points to indicate needs or wants Engages in back and forth verbal exchanges with caregivers using 2-word utterances

10. Early Childhood Outcomes Center 10 Thinking Functionally If you know that a child can point, do you know that the child can communicate her wants and needs? If you know that a child can’t point, do you know that the child can’t communicate his wants and needs? How does knowing about pointing help you understand how the child takes action to meet needs?

11. Early Childhood Outcomes Center 11 Thinking Functionally Discrete behaviors (e.g., those described by some items on assessments) may or may not be important to the child’s functioning on the outcome Individually, they are not especially informative Summed, they may or may not be useful, depending on the functionality of the behaviors/items

12. Early Childhood Outcomes Center 12 Children Have Positive Social Relationships Involves: Relating with adults Relating with other children For older children, following rules related to groups or interacting with others Includes areas like: Attachment/separation/autonomy Expressing emotions and feelings Learning rules and expectations Social interactions and play

13. Early Childhood Outcomes Center 13 Children Acquire and Use Knowledge and Skills Involves: Thinking Reasoning Remembering Problem solving Using symbols and language Understanding physical and social worlds Includes : Early concepts—symbols, pictures, numbers, classification, spatial relationships Imitation Object permanence Expressive language and communication Early literacy

14. Early Childhood Outcomes Center 14 Children Take Appropriate Action to Meet Their Needs Involves: Taking care of basic needs Getting from place to place Using tools (e.g., fork, toothbrush, crayon) In older children, contributing to their own health and safety Includes: Integrating motor skills to complete tasks Self-help skills (e.g., dressing, feeding, grooming, toileting, household responsibility) Acting on the world to get what one wants

15. Early Childhood Outcomes Center 15 Taking Action to Meet Needs Includes Integrating various skills (gross motor, fine motor, communication skills) to complete tasks Self help skills (feeding, dressing, toileting, household task) Acting on the world to get what he or she wants Not JUST acting on the world: takes APPROPRIATE action to meet needs

16. Early Childhood Outcomes Center 16 Outcomes Reflect Global Functioning Each outcome is a snapshot of: The whole child Status of the child’s current functioning Functioning across settings and situations Rather than: Skill by skill In one standardized way Split by domains

17. Early Childhood Outcomes Center 17 OSEP Reporting Categories Percentage of children who: a.Did not improve functioning b.Improved functioning, but not sufficient to move nearer to functioning comparable to same-aged peers c.Improved functioning to a level nearer to same-aged peers but did not reach it d.Improved functioning to reach a level comparable to same-aged peers e.Maintained functioning at a level comparable to same-aged peers 3 outcomes x 5 “measures” = 15 numbers

18. Early Childhood Outcomes Center 18 Helping Children Move Toward Age- expected functioning Assumption: Children can be described with regard to how close they are to age expected functioning for each of the 3 outcomes By definition, most children in the general population demonstrate the outcome in an age-expected way By providing services and supports, ECSE is trying to move children closer to age expected behavior

19. Early Childhood Outcomes Center 19 13 FunctioningFunctioning

20. Early Childhood Outcomes Center 20 Entry 14

21. Early Childhood Outcomes Center 21 EntryExit 15

22. Early Childhood Outcomes Center 22 EntryExit 16

23. Early Childhood Outcomes Center 23 Key Point The OSEP categories describe types of progress children can make between entry and exit Two scores or ratings (entry and exit) are needed to calculate what OSEP category describes a child progress

24. Early Childhood Outcomes Center 24 Understanding the reporting categories a - e e. % of children who maintain functioning at a level comparable to same-aged peers

25. Early Childhood Outcomes Center 25 EntryExit

26. Early Childhood Outcomes Center 26 EntryExit

27. Early Childhood Outcomes Center 27 d. % of children who improve functioning to reach a level comparable to same-aged peers

28. Early Childhood Outcomes Center 28 EntryExit

29. Early Childhood Outcomes Center 29 c. % of children who improved functioning to a level nearer to same aged peers, but did not reach it

30. Early Childhood Outcomes Center 30 EntryExit

31. Early Childhood Outcomes Center 31 EntryExit

32. Early Childhood Outcomes Center 32 b. % of children who improved functioning, but not sufficient to move nearer to same aged peers

33. Early Childhood Outcomes Center 33 EntryExit

34. Early Childhood Outcomes Center 34 EntryExit

35. Early Childhood Outcomes Center 35 EntryExit

36. Early Childhood Outcomes Center 36 a. % of children who did not improve functioning

37. Early Childhood Outcomes Center 37 EntryExit

38. Early Childhood Outcomes Center 38 EntryExit

39. Approach Part C (56 states) Preschool (59 states) One tool statewide 8/56 (14%) 13/59 (22%) Multiple Publishers’ online tools 2/56 (4%) 3/59 (5%) COSF 7 pt. scale 40/56 (71%) 36/59 (61%) Other 6/56 (11%) 7/59 (12%) State Approaches to Measuring Child Outcomes

40. Early Childhood Outcomes Center 40 All approaches have challenges ApproachChallenges One tool statewide Defining age expectations Defining age expectations Determining cutoffs for enough progress to be considered a change in growth trajectory Determining cutoffs for enough progress to be considered a change in growth trajectory

41. Early Childhood Outcomes Center 41 All approaches have challenges ApproachChallenges Publishers’ analysis of on- line assessment tools Aligning assessment tool items with the 3 outcomes Aligning assessment tool items with the 3 outcomes Programming the analysis to be comparable to other measurement approaches Programming the analysis to be comparable to other measurement approaches

42. Early Childhood Outcomes Center 42 All approaches have challenges ApproachChallenges Child Outcome Summary Form Getting consistency of interpretation and use Getting consistency of interpretation and use Requires understanding of child development Requires understanding of child development

43. Part C Tools for Family Outcomes # (%) of states Assessment Tool 25 (46%) NCSEAM Family Survey 20 (37%) ECO Family Survey 6 (11%) State developed surveys 3 (6%) Added ECO items and/or NCSEAM items to their state survey

44. Early Childhood Outcomes Center 44 Themes of Agenda Sessions Quality Assurance Quality Assurance Quality assessment data Quality assessment data Reliable use of tools Reliable use of tools Quality of analysis and reporting Quality of analysis and reporting Training and TA (to address quality) Training and TA (to address quality) Collaboration Collaboration Part C and 619 Preschool Part C and 619 Preschool Across Early Care and Education Across Early Care and Education

45. Early Childhood Outcomes Center 45 Themes of Agenda Sessions Challenges of particular approaches Challenges of particular approaches Decision rules for “age expectations” and progress category assignment for states using one tool statewide Decision rules for “age expectations” and progress category assignment for states using one tool statewide Consistent interpretation and use of the COSF Consistent interpretation and use of the COSF Outcomes from the local and family perspectives Outcomes from the local and family perspectives

46. Early Childhood Outcomes Center 46 Themes of Agenda Sessions Building outcomes into monitoring and accountability systems Building outcomes into monitoring and accountability systems Sampling issues and strategies Sampling issues and strategies Family outcomes Family outcomes Using data for improving family services and supports Using data for improving family services and supports Return rates and representative data Return rates and representative data