Presentation on theme: "CSPR Data Summary Presentation 2008 Even Start SEA Coordinator Meeting."— Presentation transcript:
CSPR Data Summary Presentation 2008 Even Start SEA Coordinator Meeting
2 Purpose of Collecting Even Start Data Inform the Department and Congress of Even Start accomplishments Determine where improvements are needed GPRA data collected on the CSPR report provides OMB information for program funding State agencies may use data to inform collaborators
3 Reminders This is a data reporting system, not an evaluation. There are limitations on extent to which data can be analyzed. Need to be cautious on drawing conclusions about program impact based on data.
4 What Do We Know About the Number of Subgrants?
5 Breakdown by State Allocation Categories $455,400 - $960,061 (24 States) $989,836 – 2,093,695 (17 States) 2,921,218 – 12,177,098 (10 states) Average Number of Subgrants per State 61331 Median Number of Subgrants per State 61318 Range Number of Subgrants 2-137-2211-81 Average Number of Families per Subgrant 293041 SY 2006-2007 Total Subgrants = 688 Reporting YearNumber of Subgrants 2004-20051,108 2005-20061,022 2006-2007688
6 In General Over the past three reporting years… Funding has decreased 60% Number of local grantees has declined by 38% Number of Even Start participants has declined by 48%
7 What Do We Know About Even Start Participants?
8 In 2006-2007 Even Start Participants: 23,763 Even Start families 24,711 adults (53% were English Language Learners) 34,133 children 58,844 total number of Even Start participants Of Participating children: 39% were ages birth-two 38% were ages 3-5 19% were ages 6-8 2% were over age 8 2% were reported as mixed-age group
9 Comparison Data Even Start Participants # of Families # of Adults (%ELLs) # of Children Total # of Participants 2004-200544,096 46,719 (48%) 66,220112,939 2005-200638,151 39,865 (49%) 56,40396,268 2006-200723,763 24,711 (53%) 34,13358,844
10 Characteristics of Newly Enrolled Families… Newly enrolled families: 91% at or below the Federal poverty level (State range 57% - 100%) 90% without high school diploma and/or GED (State range 40% - 100%) 55% of adults had not gone beyond 9th grade ( State range 0% - 99%)
11 Family Retention 0 – 3 Months 4 – 6 Months 7 – 12 Months 12 + Months Percent Families Retained 12+ Months 0 – 25% - 13 states 25 – 50% - 33 states 50 – 75% - 5 states 75 – 100% - 0 states Percentage of families retained in each category has remained relatively same for the past two years.
12 What Do We Learn About Participant Outcomes?
13 Indicator 1: Number of adults showing significant learning gains on measures of reading 50 States reported on this indicator Definition of significant gains for TABE and CASAS determined by states Measure# Adults Tested Percent Adults with Significant Gains State Range Significant Gains State Median Percent Gains TABE4,57468%11% - 100%68% CASAS1,09171%48% - 100%72% Other9753%35% - 100%73%
15 Indicator 2: Number of LEP adults showing significant learning gains on measures of English language acquisition 30 states reported on either the TABE and/or CASAS 30 states reported on either BEST, BEST Plus and/or BEST ORAL and/or other Definition of significant gains for measures determined by states Measure# Adults Tested Percent Adults with Significant Gains State Range Significant Gains State Median Percent Gains TABE42065%45% - 100%80% CASAS1,80675%51% - 97%78% BEST4,25877%48% - 100%83% BEST ORAL1,12278%71% - 88%78% BEST PLUS2,39971%53% - 100%76% Other10370%63% - 79%71%
17 Indicator 3A: Number of school age adults who earn a high school diploma or GED 39 states reported diploma and GED data separately 2 states reported diploma and GED combined 10 states did not report data for this indicator # Cohort Percent Making Goal State Range Earned State Median Percent Diploma57568%0% - 100%82% GED46034%27% - 100%53%
18 Indicator 3B: Number of non-school age adults who earn a high school diploma or GED 48 states reported diploma and GED data separately 1 states reported diploma and GED combined 2 states did not report data for this indicator # Cohort Percent Making Goal State Range Earned State Median Percent Diploma29270%18% - 100%52% GED2,23752%23% - 100%83%
19 Indicator 3 Comparison Data NOTE: 2004-2005 Diploma and GED data not reported separately
20 Comments on Adult Data Data was reported on approximately 79% of the total number of Even Start adults Increase in use of BEST, BEST PLUS, and BEST ORAL for Indicator 2 in 2008. Improved separate reporting of Diploma and GED data
21 Indicator 4: Number of children entering kindergarten who are achieving significant learning gains on measures of language development Pool of 4,442 children age-eligible for kindergarten in FY08 and who were in Even Start for at least six months 643 children exempted from testing 47 states reported PPVT and/or TVIP data 4 states did not report PPVT/TVIP data # Cohort Percent with Significant Gains State Range Significant Gains Average Median Percent Gain PPVT2,85575%22% - 100%79% TVIP2152%6% - 63%54%
22 Additional PPVT Data Number of children who score within age appropriate range of PPVT Number of age-eligible children in Even Start for 6 or more months with a standard score of 85 or more on Spring PPVT 22 states were able to voluntarily provide data this year Data represents 69% of this eligible pool All states expected to provide data for 2007-2008 report Eligible Pool# Tested Percent Scoring at 85 or above State RangeState Median Gains 2,6031,79966%21% - 90%71%
24 Indicator 5: The average number of letters children can identify measured by PALS Pre-K Upper Case Letter Subtest 46 states reported at least some PALS data 5 states did not report PALS data 3,026 children tested in 2006-2007 Average # Letters Recognized PALS Pre-K16.2 Reporting Year Weighted Average # Letters Children Recognized 2004-200515.6 2005-200615.2 2006-200716.2
25 Comments on PPVT and PALS Data 65% of eligible children were tested with PPVT Marked difference in PPVT pool of eligible children (4,442) and PALS pool (2,603) Marked decrease in use of TVIP 14% of eligible pool exempted from PPVT Still some states not reporting PPVT (4 states) and/or PALS (5 states) data
26 Indicator 6: Number of school-aged children who are reading on grade level 49 states reported data for this indicator 34 states provided data broken out by grade level All states expected to provide disaggregated data next year # CohortPercent Making Goal State RangeState Median Percent Gain Kindergarten2,06573%0% - 100%78% Grade 11,61573%24% - 100%78% Grade 21,16170%20% - 100%77% Grade 363861%17% - 100%75% Total6,79773%17% - 100%68%
27 Indicator 7: Number of parents who show improvement on measures of parental support for childrens learning 29 states reported PEP data 15 states reported data on other measures 7 states did not report on this indicator Other measures included surveys, indicator results, data reported on other instruments # CohortPercent Making Goal State RangeState Median Percent Gain PEP Scale I6,10355%28% - 95%79% PEP Scale II7,03164%34% - 100%79% PEP SCALE III3,14373%43% - 93%78% PEP Scale IV2,39176%47% - 93%83% Other6,21988%63% - 100%90%
28 How does Even Start Measure Up Over Time? GPRA Results NOTE: GPRA indicators are different than indicators used for CSPR reporting
29 Measure 1.1 of 5: The percentage of Even Start adults who achieve significant learning gains on measures of reading/English language acquisition, as measured by the Comprehensive Adult Student Assessment System (CASAS) and the Tests of Adult Basic Education (TABE). (Desired direction: increase) 1079 YearTarget Actual (or date expected) Status 2003Set a Baseline70Target Met 200470.760.5Did Not Meet Target 200571.463.8Made Progress From Prior Year 200672.166.3Made Progress From Prior Year 200770.972%Target Exceeded 200871.2UndefinedPending Combines CSPR Indicators 1 and 2
30 Measure 1.2 of 5: The percentage of Even Start adults with a high school completion goal who earn a high school diploma. (Desired direction: increase) 1080 YearTarget Actual (or date expected) Status 2003Set a Baseline59Target Met 200459.644.6Did Not Meet Target 200560.247.2Made Progress From Prior Year 200660.877.6Target Exceeded 200760.869%Target Exceeded 200861UndefinedPending CSPR Indicator 3A
31 Measure 1.3 of 5: The percentage of Even Start adults with a goal of General Equivalency Diploma (GED) attainment who earn a GED. (Desired direction: increase) 1081 YearTarget Actual (or date expected) Status 2003Set a Baseline44.6Target Met 200444.480.2Target Exceeded 200544.957.9Target Exceeded 200645.347.2Target Exceeded 200745.349%Target Exceeded 200848UndefinedPending CSPR Indicator 3B
32 Measure 1.4 of 5: The percentage of Even Start children who are entering kindergarten and who are achieving significant gains on receptive language on the Peabody Picture Vocabulary Test-III (PPVT - III). (Desired direction: increase) 1082 YearTarget Actual (or date expected) Status 2003Set a BaselineNot Collected 2004Set a Baseline82.9Target Met 200583.779.8Did Not Meet Target 200684.675.3Did Not Meet Target 200784.675%Did Not Meet Target 200885UndefinedPending CSPR Indicator 4
33 Measure 1.5 of 5: The number of letters Even Start children can identify, as measured by the PALS Pre-K Uppercase Letter Naming Subtask. (Desired direction: increase) 1719 YearTarget Actual (or date expected) Status 2006Set a Baseline15Target Met 2007BL+1 (16)16.2Target Met 2008BL+2 (17)(February 2009)Pending CSPR Indicator 5
34 What can States do to improve data collection? Provide additional grantee training on CSPR measures Clarify testing guidelines, e.g., scheduling of post tests Use consultants to collect CSPR data if necessary (e.g., PPVT; PALS) Use desk and onsite monitoring to reinforce importance of accurate and complete data collection Revise data collection forms as needed