1. What’s Happening with Performance Accountability – WIA to WIOA
California Workforce Association
Spring Conference
Denise Dombek
ETA Region 6, San Francisco, CA
May 12, 2015

2. Workforce Innovation and Opportunity Act - WIOA

3. Federal Register Notice
Workforce Innovation and Opportunity Act; Joint Rule for Unified and Combined State Plans, Performance Accountability, and the One-Stop System Joint Provisions; Notice of Proposed Rulemaking
Pages (115 pages) [FR DOC #: ]
Published on April 16, 2015
Written Comments must be received by no later than June 15, 2015

4. WIOA Performance Accountability – System Alignment
Ensuring that federal investments in employment and training programs are evidence-based, data-driven, and accountable to participants and taxpayers by establishing a common performance accountability system for the core programs and requiring other authorized programs to report on the common performance indicators.

5. Data Collection
For the most part, most of the performance data required by WIOA is already being collected. However, the primary indicators of performance specify outcomes with respect to quarters after exit that are different from WIA. There are also some additional data elements that will be required such as credentials attainment, measurable skills gain, training-related costs and information regarding employer engagement.

6. Policies/Procedures and Training
Data management and the resultant quality of reported data are derived from and influenced by the policies, procedures and protocols utilized at the state and/or local levels
Grantees should develop guidance for staff and sub-grantees involved in the collection of data:
Definitions of data elements
Sources of information
Participant record and documentation requirements
Procedures for collecting, entering and reporting data and associated “business rules” that cover timeliness and completeness
Procedures for entering data into an automated database
Procedures for correcting data

7. Training and Monitoring
Data collection and data entry:
Routine training should be provided for data management guidance
All staff involved in the collection or entry of data should be trained in the procedures
The data entry process should include steps for verifying entered data against original sources on a sample basis or for entire population of records

8. REPORTING
If Data is not collected and reported, it didn’t happen!!

9. WIOA Identified Programs – Common Performance Accountability measures
Core Programs
WIA (Title I)
Adult, Dislocated Worker, Youth
Wagner-Peyser (Title III)
Vocational Rehabilitation (Title IV)
Adult Education (Title II)
Additional Programs
Job Corps
Native American
Migrant and Seasonal Farmworker
YouthBuild

10. WIA Notable Changes - Performance10
WIA Notable Changes - Performance
Additional Measures – Employer, Skills
Tracking of “Efficiency” Outputs
Common Reporting/Tracking: Core Programs
UI Wage Record Access for Core Programs
Sanctions for “Failure” – Reporting, Outcomes
ETPL Reporting Changes – incl. scope of trainees
Regression Models - Negotiations, Measurement
Pay-for-Performance Contracting Allowability
Dissemination of Effective Practices

11. Pay for Performance
Local Areas may use up to 10% of Adult and Dislocated Worker funds for pay-for-performance contract strategies.
Based on the achievement of specified levels of performance on the core program’s performance measures (primary indicators of performance)
Further provisions included in Notice of Proposed Rulemaking (NPRM) and additional guidance planned on the appropriate use of pay-for-performance contract strategies.

12. Performance Accountability *unless State ‘early implementer’
WIA (Workforce Investment Act) effective through PY15
WIOA (Workforce Investment and Opportunity Act) effective PY16*
‘Services’ based Participation and Exit
Data Validation required
Reporting Cohort primarily 1st to 3rd Qtr after Exit
Nine Common Measures
Reporting Participant Information
Sequence of Services – Core, Intensive, Training
‘Services’ based Participation and Exit
Data Validation codified
Reporting Cohort extended 2nd to 4th Qtr after Exit
Twelve Primary Indicators of Performance
Expanded Reporting Participant Information
‘Career Services’ and Training
Performance Accountability *unless State ‘early implementer’

13. WIA Participant
An individual determined eligible to participate in the program who receives a service funded by the program in either a physical location (e.g., One-Stop Center) or remotely through electronic technologies.
Three Components
Determined eligible to participate in the program
Receives a funded service
In either a physical location or through electronic technologies

14. WIOA “Participant” When does participation begin?
What services commence participation and inclusion in performance accountability?
What is impact of self service?
Reported across Core Programs?

15. WIA Exiter
A participant who hasn’t received a program or partner-funded service for 90 consecutive days and no future services are scheduled
Three components
Hasn’t received a service
For 90 consecutive days
No future services scheduled

16. WIOA “Exit” When is it appropriate to Exit? Same for all Programs?
Youth participants?
Common or Program Exit?

17. A WIA Service Is: Any core, intensive or training activity
made available to eligible participants that
allows them to benefit from specific
programs in the workforce system.

18. WIOA “Service” No longer ‘sequence of services’
Core and Intensive = Career Services
What commences and continues participation?

19. WIA Entered Employment Rate
Of those who are not employed at the date of participation:
Number of adult participants who are employed in the 1st quarter after the exit quarter
Number of adult participants who exit during the quarter

20. WIA Employment Retention Rate
Of those who are employed in the first quarter after the exit quarter:
Number of adult participants who are employed in both the second and third quarters after the exit quarter
Number of adult participants who exit during the quarter

21. WIA Average Six-Month Earnings
Of those adult participants who are employed in the first, second and third quarters after the exit quarter:
Total earnings in the second quarter plus total earnings in the third quarter after the exit quarter
Number of adult participants who exit during the quarter

22. WIA PLACEMENT IN EMPLOYMENT OR EDUCATION
Of those not employed, in the military or in post-secondary education at participation:
Number of youth employed, in the military or enrolled in post-secondary education and/or advanced training or occupational skills training in the 1st quarter after exit
Number of exiters

23. WIA ATTAINMENT OF DEGREE OR CERTIFICATE
Of those enrolled in education at participation or any time during the program:
Number of Youth who attained a diploma, GED or certificate by the end of the 3rd quarter after exit
Number of Exiters 23

24. WIA LITERACY/NUMERACY GAINS
Of those out-of-school youth who are basic skills deficient:
Number of Youth participants who increase one or more educational functioning levels
Number of youth who completed a year of participation (based on date of 1st youth service) PLUS Number of youth who exit before completing a year of participation 24

25. Core Programs’ Performance Measures (except WIOA Youth)
Employment
2nd quarter after exit
4th quarter after exit
Earnings
New; Median earnings 2nd quarter after exit
Credential Rate
New; Up to one year after exit; Doesn’t apply to WP
In-Program Skills Gain
New; Achieving measurable skills gains, Doesn’t apply to WP
Employer Effectiveness
New; before PY16

26. WIOA Youth Performance Measures
Education/Employment
2nd quarter after exit
4th quarter after exit
Earnings
Median earnings 2nd quarter after exit
Credential Rate
Up to one year after exit
If HS Dip/GED, must include Employment/Postsecondary
In-Program Skills Gain
Achieving measurable skills gains
Employer Effectiveness
before PY16

27. Employment Measure - WIA to WIOA Reporting Time Periods
For the Quarter ending Sept 2014
2013
2014
Jan-Mar
Apr-June
July-Sept
Oct-Dec
Exit Cohort
Employment/Education Qtr
2 Qtr Wage Delay
Nov 15th
2015
Jan-Mar
Feb 14th

28. WIOA – What’s Eliminated
Literacy/Numeracy indicator for youth
Although utilized in development of Skills Gain measure
Customer Satisfaction as statutory measure
State Incentive Funds
But Governor’s reserve may be used for local incentives

29. WIOA Youth Program Design
Focus on Out of School Youth
75% of formula youth funds minimum
Work Experience Expenditure
20% of local area funds minimum
Eligible Out-of-School Youth Age
16-24 year olds
In-School Youth Age
14-21 year olds
New Program Elements
5 new elements

30. WIOA Youth Program Transition
Youth PY 2015 Funding
April 1, 2015
WIOA Implementation
July 1, 2015
TEGL While WIOA is effective July 1, 2015 and the Youth funds allotments are provided April 1, 2015, and it will take some time to transition, States and Local Areas must begin to incorporate strategies for recruiting and serving more OSY with the receipt of PY 2015 funds. Progress must be documented, including plans to achieve 75% expenditure rate with future funds.

31. Additional Provisions
State Targets
Must use statistical adjustment model—use now codified (Sec. 116(b)(3)(A)(viii))
Targets for first two years included in State Plans
Additional Information required in Annual Reports
Example: Amount of funds spent on each type of service
Data Validation now codified (Sec. 116(d)(5))

32. Additional Provisions
Sanctions
State Level
If a state fails performance a first year, TA will be provided (used to say will provide TA upon request)
If a state fails performance a 2nd consecutive year or fails to submit an Annual Report for any year, it can lead to a 5% reduction in statewide funds (stronger language)
Local Level
If failure continues for a 3rd consecutive year, the Governor must take corrective action which shall include development of a reorganization plan (and new local board)

33. WIOA State Reporting State Performance Reports will include:
Information specifying levels of performance for the primary indicators
State adjusted levels of performance for each program
Performance information aggregated by individuals with:
Barriers to employment
Subpopulation of these individuals according to race, ethnicity, sex and age
Total participants served by each program
The percentage of the State’s annual allotment spent on administrative costs

34. WIOA State Reporting (cont)
Information on participants in career and training services during the program year and the 2 preceding programs years:
The number of participants enrolled
The number of participants who exited
The total amount of funding expenditures
The average cost/participant
The number of participants enrolled in more than 1 program
The number of participants with barriers to employment
Administrative costs

35. WIOA State Reporting-Pay for Performance
Pay-for-performance contracts for program strategies:
The performance of the service providers measured against contract-specified performance measures
An evaluation of the design of the programs and performance of the strategies
Where possible, levels of satisfaction among employers and participants
Other information that facilitates comparisons with programs in other states.

36. WIOA Local Reporting
Local Performance Reports will include everything in the State reports in addition to the following:
The percentage of the Local’s annual allotment spent on administrative costs; and
Other information that facilitates comparisons of programs in other local areas

37. WIOA Eligible Training Providers (ETP) Reporting
ETPs provide student performance outcome data in State reports, which must include:
The Total number of individuals exiting a program (WIOA-funded and non-WIOA-funded)
Elements relating to the number of WIOA participants receiving & exiting training
Average cost
Number of special populations served.

38. Timeline for WIOA Performance Transition
Date
Action
Proposed regulations published
Comment Period Ends
Templates for state, local, and ETP performance reports
PY2016 Performance Targets negotiated
Employer Effectiveness measure developed
Full implementation of WIOA performance measures
April 16, 2015
June 15, 2015
July 22, 2015
March 3, 2016
June 30, 2016
July 1, 2016

39. WWW.DOLETA.GOV/WIOA WIOA Resource Page39
Fact Sheets
NPRM Webcast
Notice of Proposed Rulemaking Updates
Guidance
WIOA Technical Assistance Tools and Resources

40. Questions
Final Questions or Comments