1. Common Measures for the Workforce Investment Act (WIA) An equal opportunity employer/program. Auxiliary aids and services are available upon request to individuals with disabilities. All voice telephone numbers on this document may be reached by persons using TTY/TDD equipment via the Florida Relay Service at 711.

2. Workforce Summit 20052 An equal opportunity employer/program. Auxiliary aids and services are available upon request to individuals with disabilities. All voice telephone numbers on this document may be reached by persons using TTY/TDD equipment via the Florida Relay Service at 711.

3. 3 Common Measures

4. 4 Establishing Common Measures President’s Management Agenda Affects six agencies (29 programs) –Department of Labor –Department of Education –Department of Health and Human Svcs. –Department of Veterans Affairs –Department of the Interior –Department of Housing and Urban Development TEGL 17-05 issued on February 17, 2006 –Rescinds TEGLs 28-04 and 15-03 –Policy applies to DOL funded programs only –July 1, 2005, implementation for W-P, VETS and WIA; October 1, 2005, implementation for TAA

5. 5 Benefits of Common Measures Focus on the core purposes of the workforce system; employment for adults and skill gain for youth Break down barriers to integration resulting from different definitions, data and reports for each workforce program Resolve questions raised by GAO and other oversight agencies regarding the consistency and reliability of data Reduce confusion among our customers and stakeholders who want to know about results

6. 6 The Common Measures Adult measures: (Adults and DWs) –Entered employment –Employment retention –Earnings increase (PY 05) –Average Earnings (PY 06) Youth and lifelong learning measures: (Ages 14-21) –Placement in employment or education –Attainment of a degree or certificate –Literacy or numeracy gains

7. 7 The Common Measures and Revised Reporting Requirements for WIA Programs

8. 8 Common measure outcomes will be collected through revised reports Common measure definitions replace existing program-specific performance measure definitions where possible Efficiency measures to be computed at Federal level only Roll-Out of Common Measures

9. 9 Earnings gain Employment retention rate at six months WIA Adult WIA Adult Core Performance Measures Adult Common Adult Common Performance Measures Adult entered employment rate Adult employment retention rate Adult earnings increase (PY 05) Adult average earnings (PY 06) Entered employment rate Employment and credential rate WIA Adult Program Measures Roll-Out of Common Measures Note: Regions have negotiated performance goals for entered employment, retention, earnings gain & credential for PY05 and PY06.

10. 10 Earnings replacement Employment retention rate at six months WIA Dislocated Worker WIA Dislocated Worker Performance Measures Adult Common Adult Common Performance Measures Adult entered employment rate Adult employment retention rate Adult earnings increase (PY 05) Adult average earnings (PY 06) Entered employment rate Employment and credential rate WIA Dislocated Worker Program Measures Roll-Out of Common Measures Note: Regions have negotiated performance goals for entered employment, retention, earnings gain and credential measures for PY05 and PY06.

11. 11 WIA Youth Program Measures Roll-Out of Common Measures Youth Common Performance Measures States have negotiated performance goals for WIA programs according to Federal measures for PY 2005 and PY 2006 Younger Youth Skill attainment rate Diploma attainment rate Retention rate Older Youth Entered employment Employment retention Earnings change Employment and credential rate

12. 12 WIA Youth Program Measures Roll-Out of Common Measures Youth Common Performance Measures Placement in employment or education/ advanced training (PY05) Attainment of a degree or certificate (PY05) Literacy and Numeracy gains (PY06) As of 06/15/2006 there has been no negotiated performance goals for the youth common measures.

13. 13 Key Concepts

14. 14 Program Participation A participant is a person who is determined eligible to participate in a program and receives a service funded by the program in a physical location The date of participation is the date of the first service after eligibility determination Individuals who receive services that are accessed by virtual means outside of the program’s facility need not, but may, be treated as participants

15. 15 Program Participation Generally, all participants will be taken into account when computing performance outcomes under the common measures Two types of participants may be excluded from the performance calculations: Participants who do not voluntarily disclose valid Social Security numbers Participants who are excluded from the calculations by law (death, health/medical, institutionalized, etc.)

16. 16 At a minimum, data needed from self-service participants:  social security number (SSN)  employment status at the point of participation. Upon request of a customer’s SSN, the customer must also be offered the opportunity to provide Equal Employment/demographic information. Minimum Data Needed from Self- Service Participants

17. 17 Program Exit  Exit (for reporting purposes) occurs when... Participant does not receive a service or partner service for 90 consecutive calendar days; Participant has no planned gap in service; and Participant is not scheduled for future services  Date of exit is applied retroactively to the last day of service funded by the program or partner program  The State has the capability to track partner services in order to extend the date of exit

18. 18 Program Exit Days included in any planned gap in services do not count when determining the exit date –Delay before the beginning of training –Health condition or providing care for a family member with a health condition –Temporary move from the area –All gaps in service must be documented

19. 19 Exclusions from Performance Exclusions from all common measures: –Persons institutionalized (exceptions are detained Responsible Reintegration of Youthful Offenders and disabled individuals residing in institutions) –Persons unable to continue due to health/medical or family care reasons –Deceased –Reservists called to active duty –Relocated to a mandated residential program (youth only) To be excluded from performance calculations, the event must be expected to last 90 days or more

20. 20 Calculating Outcomes Adult Measures

21. 21 Adult Entered Employment Employment at participation is based on information from the individual -- not wage records Exclude adults employed at the time of participation Include adults employed at the time of participation who are on layoff notice Supplemental data will not be used in Florida Wage records only will be used to determine employment in the quarter after exit Computing Outcomes Number employed in quarter after exit Number of exiters Of those not employed at participation:

22. 22 YES Numerator Denominator Excluded YES Employed in quarter after exit? NO Employed at participation? Adult Entered Employment NO

23. 23 Adult Employment Retention Based on those employed in quarter after exit Employment in the 1 st, 2 nd and 3 rd quarters after exit does not have to be with the same employer Must be employed in both the 2 nd and 3 rd quarters after exit to count as retained Only UI Wage records will be used Supplemental data will not be used in Florida Computing Outcomes Of those employed in the quarter after exit: Number employed in both the 2 nd and 3 rd quarters after exit Number of exiters

24. 24 Employed in quarter after exit? YES Employed in 2 nd and 3 rd qtr. after exit? YES Numerator Denominator Excluded NO Adult Employment Retention NO

25. 25 Adult Earnings Increase For program year 05-06 only Only wage records may be used for determining pre-program and post-program earnings Includes same population as the adult retention measure Likely to be negative for dislocated workers - Number exiters Of those employed in the quarter after exit: Earnings in 2 nd and 3rd quarter after exit Earnings in 2 nd and 3rd quarter prior to participation Computing Outcomes

26. 26 Employed in qtr. after exit? Excluded Included NO YES Adult Earnings Increase

27. 27 Adult Average Earnings Effective July 1, 2006 Only wage records may be used for determining average earnings Includes same population as the adult retention measure Number exiters Of those employed in the first, second, and third quarters after exit: Total earnings in the 2 nd quarter plus total earnings in the 3 rd quarter after exit Computing Outcomes

28. 28 Employed in qtr. after exit? Excluded Employed in 2 nd qtr. after exit? Included NO Employed in 3rd qtr. after exit? YES Adult Average Earnings NO YES

29. 29 Calculating Outcomes Youth Measures

30. 30 Youth Measures Requirements Reporting for Program Year ending June 2006: –7 current WIA youth measures (4 OY and 3 YY) – negotiate on these for accountability –First 2 youth common measures (placement and certificate) –Lit/Num common measure required for new youth enrolled beginning July 1, 2006 –No negotiation on Lit/Num measure in PY 05

31. 31 Youth Common Measures Placement in Employment, Education, or Training Attainment of a Degree/Certificate Literacy/Numeracy Gains Note: Youth Common Measures include all youth, no longer a distinction between younger/older youth

32. 32 Placement In Employment or Education Number of youth in employment, military service, enrolled in post-secondary education, advanced training, or occupational skills training in the quarter after exit Number of exiters Of those who are not in post-secondary education, employment, or the military at participation: Computing Outcomes

33. 33 Youth and Lifelong Learning Placement In Employment or Education Excludes youth in employment, military service, or post-secondary education at participation Includes youth in secondary education at exit Employment, military and education status at participation are based on information from the youth

34. 34 Youth and Lifelong Learning Placement in Employment or Education Employment and military service in the 1 st quarter after exit is based on UI wage data Includes first quarter after exit only Currently no common measures for retention or earnings change

35. 35 NO YES Numerator Denominator NO Did the qualifying outcome occur in the 1 st quarter after exit? Youth and Lifelong Learning Placement in Employment or Education In post-secondary education, employment, or the military at participation? Excluded YES

36. 36 Attainment of Degree or Certificate Computing Outcomes Of those enrolled in education at participation or any time during the program: Number attaining a diploma, GED or certificate by the end of the 3rd quarter after exit Number of exiters

37. 37 Youth and Lifelong Learning Attainment of Degree or Certificate Education refers to secondary school, post-secondary school, adult education, or any organized program of study approved by the Florida Department of Education Includes youth in secondary school at exit Outcome can be attained during participation Diploma is any credential the Florida Department of Education accepts as equivalent to a high school diploma

38. 38 Youth and Lifelong Learning Attainment of Degree or Certificate –awarded in recognition of an attainment of measurable technical or occupational skills necessary to gain employment or advance within an occupation. –Technical or occupational skills are based on standards developed or endorsed by employers. –Recognition of generic pre-employment and/or work readiness skills are not considered certificates. Definition applies only to youth attainment of degree or certificate common measure Defining “certificate”… Computing Outcomes

39. 39 Definition of Certificate (cont.) Awarding Institutions include: – A State educational agency – Institution of higher education – Professional, industry or employer organization or a product manufacturer – Registered apprenticeship program – Public regulatory agency – A program approved by the Dept of Veterans Affairs –Office of Job Corps –Indian Tribe Higher Education Institution

40. 40 NO Enrolled in education at participation or any time during the program? Excluded NO YES Attained diploma, GED or certificate by the end of the 3 rd quarter after exit? Youth And Lifelong Learning Attainment of Degree or Certificate YES Numerator Denominator YES

41. 41 Youth and Lifelong Learning Literacy or Numeracy Gains Number who completed a year of participation Of those out-of-school youth who are basic skills deficient: Number who increase one or more educational functioning levels Number who exit before completing a year of participation + Computing Outcomes

42. 42 Youth and Lifelong Learning Literacy or Numeracy Gains Excludes youth who are not basic skills deficient Excludes youth who are in-school Includes individuals with learning disabilities To be in the numerator, an individual must advance one or more Adult Basic Education (ABE) or English as a Second Language (ESL) functioning levels

43. 43 Tests cross-walked with ABE and ESL levels include: –Comprehensive Adult Student Assessment Instrument (CASAS) –Test of Adult Basic Education (TABE) –Adult Basic Learning Examination (ABLE) –Student Performance Levels for ESL –Basic English Skills Test (BEST) for ESL –WorkKeys (for the top 3 ABE levels) Youth and Lifelong Learning Literacy or Numeracy Gains

44. 44 Individuals should be pre-tested within 60 days of the participation date or obtain a pre-test completed by a partner agency within 6 months of the participation date may be used Requires the use of the same standardized test for both pre and post assessments Individuals with disabilities should be accommodated according to guidelines associated with the assessment tool and state law or policies Individuals should be post-tested by the end of one year of participation and compared to pre-test results obtained during the initial assessment Youth and Lifelong Learning Literacy or Numeracy Gains

45. 45 If a youth continues to be basic skills deficient after the first 12 months of participation, then s/he should continue to receive training in literacy and/or numeracy skills until they become basic skills sufficient Participants should be post-tested and included in the measure at the completion of the 2 nd year Only included in measure a second time if they complete a full 2 nd year in program Youth and Lifelong Learning Literacy or Numeracy Gains Computing Outcomes

46. 46 If you have questions: Antonio L. Carter Senior Management Analyst Supervisor One-Stop & Program Support Department of Economic Opportunity (850)245-7406 tony.carter@deo.myflorida.com

47. 47 The End