2. Welcome to Salt Lake City ICESA’s 64th Annual Conference September 2000 WIA & WRIS: Florida’s Experience to date...

3. Presentation Topics Brief FETPIP Overview W.I.A. Customer Types & Categories W.I.A. Performance Measures Florida’s Negotiated Goals & Results to date Timing of Florida UI data availability & reports W.R.I.S. Usage & Results Review of electronic resources on CD

4. Florida Education & Training Placement Information Program (F.E.T.P.I.P) n Is an interagency data consumer reporting system, administered through the State Department of Education n It was designed & developed to follow-up all participants from Florida’s education and vocational training programs

5. Cooperating Agencies U.S. Govt. Agencies n Postal Service n Dept. of Defense n Office of Personnel Mgt. Florida State Depts. of n Education n Labor n Corrections n Families & Children n Management Services n Board of Regents

6. Data Items Collected Employment – Industry, Occupation, Florida Earnings – Federal Employment, Military Service Florida Postsecondary Education – School,College, or University w/program Public Assistance in Florida – TANF, Foodstamps Corrections – Incarcerations, Releases

7. FETPIP RECORD MATCHING n Quarterly record matches with Florida’s Wage Records for the W.I.A., Welfare Reform, Dept.’s of Corrections, Children & Families, Blind Services, Voc.Rehab, others… n Annual record linkages with 11 external automated databases performed annually for 300+ different follow-up files.

8. MAJOR USES OF FETPIP DATA n Placement & Accountability n Community College Performance Budgeting & Accountability n Occupational Forecasting Conference n Performance Based Program Budgeting n Federal Vocational Reporting n University System Program Reviews n Corrections Performance Based Funding n Return on Investment & Program Audit Reviews n Career Counseling and Guidance Information n W.I.A. Performance Measures

9. Internet & Electronic Media Internet & Electronic Media Articulation Reports Articulation Reports OIS Screens OIS Screens Ad Hoc Reports Ad Hoc Reports Presentations Presentations Dissemination of Data Annual Publications Annual Publications Performance & Accountability Reports Performance & Accountability Reports Employer Opinion Survey Employer Opinion Survey

10. Federal Performance Initiatives WIA requires, and Perkins III urges use of wage and administrative records.

11. WIA Customer Groups Adults Youths 19-21 years old Dislocated Workers Youths 14-18 years old

12. Adults All “exiters” aged 18 or more who received core services, intensive services or training services funded by adult programs Excludes those who receive services that are self-service or informational

13. Dislocated Workers All “exiters” who received core services, intensive services or training services funded by the dislocated worker program Excludes those who receive services that are self-service or informational

14. Youths 19-21 Years Old Exiters aged 19 or more on the last service date Received Services from the youth program

15. Youths 14-18 Years Old Were between the ages of 14 to 18 on their registration date Received services from the youth program

16. WIA Core Indicators 1 Adult Entered Employment Rate 2. Adult Employment Retention Rate at 6 months 3. Adult Average Earnings Change in 6 months 4. Adult Employment & Credential Rate 5. Dislocated Worker Entered Employment Rate 6. Dislocated Worker Employment Retention Rate 7. Dislocated Worker Earnings Replacement Rate 8. Dislocated Worker Employment & Credential Rate 9. Older Youth (19-21) Entered Employment Rate 10. Older Youth (19-21) Employment Retention Rate 11. Older Youth (19-21) Average Earnings Change 12. Older Youth (19-21) Credential Rate Note: Indicators in black are determinable from UI records, those listed in italics are not or not entirely....

17. WIA Core Indicators cont’d 13. Younger Youth (14-18) Skill Attainment Rate 14. Younger Youth Diploma or Equivalent Attainment 15. Younger Youth Retention Rate 16. Participant Satisfaction 17. Employer Satisfaction

18. Entered Employment Rate (Adults and Dislocated Workers only) Of those who are not employed at registration: Number of customers who have entered employment by the end of the 1st quarter after exit the number of individuals who exit during the quarter *Employment at registration is based on information collected from the registrant, not on UI wage records. **Dislocated Workers are unemployed by definition; therefore, all are included.

19. Employment Retention at 6 months (Adults and Dislocated Workers only) Of those who are employed in the 1st quarter after exit: Number of individuals who are employed in third quarter after exit number of adults who exit during the quarter * Employment in the 1st and 3rd quarters following exit does not have to be with the same employer

20. Average Earnings Change in 6 months (Adults only) Of those who are employed in the first quarter after exit: Total post-program earnings (earnings in quarter 2 + quarter 3 after exit) minus pre-program earnings (earnings in quarter 2 + quarter 3 prior to registration) Number of individuals who exit during the quarter * UI wage records will be the only data source for this measure. Individuals with pre or post-program supplementary employment data should be excluded.

21. Earnings Replacement Rate (Dislocated Workers only) Of those who are employed in the 1st quarter after exit: Total post-program earnings (earnings in quarter 2 + quarter 3 after exit) Pre-dislocation earnings (earnings in quarter 2 + quarter 3 prior to dislocation) * UI wage records will be the only data source for this measure. ** If there is no date of dislocation or if the date of dislocation is after registration, use the 2nd & 3rd quarters prior to registration.

22. Employment and Credential Rate (Adults and dislocated workers only) Of individuals who received training services: Number of individuals who were employed in the 1st quarter after exit and received a credential by the end of the 3rd quarter after exit Number of individuals who exited services during the quarter * Credentials can be obtained while a person is still participating in services and up to 3 quarters following exit.

23. Older Youth Entered Employment Rate Of those who are not employed at registration AND who are not enrolled in post-secondary or advanced training in the 1st quarter after exit: Number of older youth who have entered employment by the end of the 1st quarter after exit Number of older youth who exit during the quarter * Employment at registration is based on information collected from the registrant, not on UI wage records ** Individuals in both employment and post-secondary or advanced training in the first quarter after exit will be included in the denominator

24. Older Youth Employment Retention Of those who are employed in the 1st quarter after exit and who are not enrolled in post-secondary education or advanced training in the 3rd quarter after exit: Number of older youth who are employed in the third quarter after exit Number of older youth who exit during the quarter * Employment in the 1st and 3rd quarters following exit does not have to be with the same employer

25. Older Youth Average Earnings Change Of those who are employed in the 1st quarter after exit and who are not enrolled in post-secondary education or advanced training in the third quarter after exit: Total post-program earnings (earnings in quarter 2 + quarter 3 after exit) minus pre-program earnings (earnings in quarter 2 + quarter 3 prior to registration) number of individuals who exit during the quarter * UI wage records will be the only data source for this measure. Individuals with pre or post-program supplementary employment data should be excluded.

26. Older Youth Credential Rate Number of older youth who are in employment, post- secondary education, or advanced training in the 1st quarter after exit and received a credential by the end of the third quarter after exit Number of older youth who exit during the quarter * All older youth exiters will be included in this measure ** Credentials can be obtained while a person is still participating in services.

27. Younger Youth Skill Attainment Rate Of all in-school and any out-of-school youth assessed to be in need of basic skills, work readiness skills, and/or occupational skills: Total number of basic skills goals attained by younger youth plus the number of work readiness skills goals attained by younger youth plus the number of occupational skills goals attained by younger youth The total number of basic skills goals + the number of work readiness skills goals + the number of occupational skills goals set. *All youth must have a minimum of one goal set per year and a maximum of three goals per year.

28. Younger Youth Diploma or Equivalent Attainment Of those who register without a diploma or equivalent: Number of younger youth who attained secondary school diploma or equivalent by the end of the 1st quarter after exit Number of younger youth who exit during the quarter (except those still in secondary school at exit)

29. Younger Youth Retention Rate Number of younger youth found in one of the following categories in the third quarter following exit: - post secondary education - advanced training - employment - military service - qualified apprenticeships divided by: the number of younger youth who exit during the quarter (except those still in secondary school at exit)

30. Participant Satisfaction The weighted average of participant ratings on each of the three questions regarding overall satisfaction are reported on a 0 - 100 point scale. The score is a weighted average, not a percentage. 500 completed participant surveys must be obtained each year for calculation of the indicator. Responses are obtained using a uniform telephone methodology. Participants should be contacted within 60 days of the exit date or the date that an exit has been determined.

31. Participant Satisfaction Questions Utilizing a scale of 1 to 10, where “1” means “Very Dissatisfied” and “10” means “Very Satisfied,” What is your overall satisfaction with the services provided? Considering all of the expectations you may have had about the services, to what extent have the services met your expectations? “1” now means “Falls Short of Your Expectations” and “10” means “Exceeds Your Expectations.” Now think of the ideal program for people in your circumstance. How well do you think the services you received compare with the ideal set of services? “1” now means “Not very Close to the Ideal” and “10” means “Very Close to the Ideal.”

32. Employer Satisfaction The weighted average of employer ratings on each of the three questions regarding overall satisfaction are reported on a 0 - 100 point scale. The score is a weighted average, not a percentage. 500 completed participant surveys must be obtained each year for calculation of the indicator. Responses are obtained using a uniform telephone methodology. Employers should be contacted within 60 days of the completion of service or 30-60 days after a job order has been listed where no referrals have been made.

33. Employer Satisfaction Questions Utilizing a scale of 1 to 10, where “1” means “Very Dissatisfied” and “10” means “Very Satisfied,” What is your overall satisfaction with the service(s) provided? Considering all of the expectations you may have had about the services, to what extent have the service(s) met your expectations? “1” now means “Falls Short of Your Expectations” and “10” means “Exceeds Your Expectations.” Now think of the ideal service(s) for people in your circumstance. How well do you think the service(s) you received compare with the ideal set of service(s)? “1” now means “Not very Close to the Ideal” and “10” means “Very Close to the Ideal.”

34. Negotiated vs Actual Florida Performance Levels (98 4,99 1,99 2 ) Adults Negotiated Actual Entered Employment Rate 64.3% 65.94% Retention rate 78.11% 80.54% Earnings Gain $3,755 $4,367 Employment & Cred. Rate 40.0% ---

35. Negotiated vs Actual Florida Performance Levels (98 4,99 1,99 2 ) Dislocated Workers Negotiated Actual Entered Employment Rate 60% 73.15% Retention Rate 75% 84.71% Earnings Replacement 80% 169.59% Employment & Cred. Rate 35% ---

36. Negotiated vs Actual Florida Performance Levels (98 4,99 1,99 2 ) Youth 19-21 Negotiated Actual Entered Employment Rate 65.63% 68.11% Retention Rate 75.00% 80.32% Earnings Gain $3,452 $3,916 Credential Rate 15.00% ---

37. Youth 14-18 Years Old Negotiated Florida Performance Levels Skill Attainment Rate = 65% Diploma or Equivalent Rate = 20% Retention Rate = 5%

38. Florida UI Data Availability

39. Florida WIA “File Types” New participant files for obtaining pre- registration UI quarters (batched by reg. Qtr) Participant Exit Files- used for record linkages Outcome files with pre-registration UI qtrs & post program UI quarters per “Exit” quarter

40. “Exit” identification strategies... Hard Exits vs. Soft Exits Hard Exit - a participant who has a date of case closure, completion or known exit from WIA-funded or non-WIA funded partner service within the quarter. Soft Exit - a participant who does not receive any WIA-funded or non-WIA funded partner service for 90 days and is not scheduled for future services except follow-up services. By default, the last date of service is the exit date.

41. Florida’s Schedule for 1st “True” WIA QTR Exit File Delivery, Match Schedule and Reports for 1st Quarter PY99 of WIA

42. Suggestions... “Clean up” prior records before transition or as soon as possible… Have WIA performance measure baseline data on former JTPA participants for regional and statewide users, know where you are at when setting goals and prior to negotiations… Implement System design changes as soon as possible with proper training... Hard Exits & Soft Exits

43. Develop new means and systems for capturing educational enrollments and credentials following services...! Develop reports from WIA client systems for timelier information for management- WIA measurement occurs s l o w l y… Use client system reports for monitoring reporting quality and “reasonableness”, spotting & reporting data anomolies early, building incentives for on-time, right the first time reporting.

47. other various state level WIA contacts... Florida: Mike Switzer - (850) 922-9047 Antonio Carter - (850) 487-0900 Indiana: Nina Babich - (317) 232-7381 Kentucky: William Gaunce - (502) 564-5360 Nevada: Liv Jones - (702) 486-6511 Val Hopkins - (775) 684-4076 Oklahoma: Glen Roberts - (405) 557-5329 Pennsylvania: Mary Ann Regan (717) 787-3266 Tennessee: Carol Groppel - (615) 253-1330 Texas: Robert Milne - (512) 936-3300 Shu-Ching Chen - (512) 936-3300 Utah: Rick Little - (801) 526-9719 Vermont: Ted Kinerson - (802) 828-4166

48. Visit our homepage at... www.firn.edu/doe/fetpip/fetpip/fmain.htm Duane Whitfield 325 W. Gaines St Rm 844 Tallahassee, Fl 32303-0400 (850) 487-0900 whitfid@mail.doe.state.fl.us