1. 1 Employment Service Systems Research and Training Center David Vandergoot, Ph.D., Co-Principal Investigator Robert Stensrud, Ph.D. Co-Principal Investigator Developing an Evidence Base for Evaluation Research The ESSRTC is supported through Grant No. H133B040014 to Hunter College, City University of New York from National Institute on Disability and Rehabilitation Research, U.S. Department of Education.

2. 2 ESSRTC Projects Study RSA 911 to Identify Predictors of Unsuccessful Closures Study Best Practices in VR Counselors Study Current Consumer Satisfaction with VR and One-Stop Services Study One-Stop Collaboration and Integration Study Provider Collaboration Around Demand Side Services Demonstrate Models for Predicting Employment of People with Disabilities for State Planning Design Employment Service Systems to Develop and Demonstrate Evidence-Based Practices

3. 3 ESSRTC Products Employer Openness Survey Consortium for Employment Success Model VR Current Consumer Satisfaction Survey VR Closed Consumer Satisfaction Survey VR Consumer Satisfaction Follow-Up Survey Employment Prediction Model DigitalChalk Training Modules

4. RSA 911 National Data Closed Before Plan Initiated (Status 30) 4

5. New York VR (VESID) Data Closed Before Plan Initiated (Status 30) 5

6. RSA 911 National Data Closed After Plan Initiated (Status 28) 6

7. Comparison – National vs. State Data 7

8. Consumer Satisfaction Survey Current Consumer Satisfaction with VR and Partner Services Consumer Satisfaction at Case Closure Consumer Satisfaction at 12-Month Follow- Up Tied to Case Data Tied to Service Self-Assessment Data Can Be Tied to Employment Forecasting Model

9. VESID Survey 12 month Response Rates Response rate: 595 of 5003 surveys returned (11.9% response rate) Response rate by closure status: Status 26: 410 of 2730 (15%) Status 28: 185 of 2273 (8.1%)

10. Employment Outcomes Closure Status Employed full time Employed part-time Self- employed Employed Supp. Emp. Employed Sheltered Not employed but looking Not seeking employ. 26 - successful 36.6%27%3.1%3.8%019.3%10.2% 28 - unsuccessful 11.9%10.2%2.3%2.8%1.1%44.1%27.7%

11. Weekly Earnings FrequencyPercent Valid Percent Cumulative Percent Valid 1 $50 or less599.915.8 2 $51 to $100508.413.429.2 3 $101 to $2007412.419.849.1 4 $201 to $3006010.116.165.1 5 $301 to $400508.413.478.6 6 $401 to $500315.28.386.9 7 $501 to $750315.28.395.2 8 $751 or more183.04.8100.0 Total37362.7100.0 Missing System22237.3 Total595100.0

12. Health Benefits from Job FrequencyPercent Valid Percent Cumulative Percent Valid No16427.663.1 Yes9616.136.9100.0 Total26043.7100.0 MissingSystem33556.3 Total595100.0

13. Opportunities for Advancement FrequencyPercent Valid Percent Cumulative Percent Valid No13322.447.2 Yes14925.052.8100.0 Total28247.4100.0 MissingSystem31352.6 Total595100.0

14. More Financially Independent FrequencyPercent Valid Percent Cumulative Percent Valid No7913.331.2 Yes17429.268.8100.0 Total25342.5100.0 MissingSystem34257.5 Total595100.0

15. Improved Job Skills FrequencyPercent Valid Percent Cumulative Percent Valid No589.725.0 Yes17429.275.0100.0 Total23239.0100.0 MissingSystem36361.0 Total595100.0

16. Because of Job QOL Improved FrequencyPercent Valid Percent Cumulative Percent Valid No569.422.8 Yes19031.977.2100.0 Total24641.3100.0 MissingSystem34958.7 Total595100.0

17. Participation in Work-Related Social Events FrequencyPercent Valid Percent Cumulative Percent Valid No14223.951.4 Yes13422.548.6100.0 Total27646.4100.0 MissingSystem31953.6 Total595100.0

18. Because of Job Able to Meet More People FrequencyPercent Valid Percent Cumulative Percent Valid No11920.042.8 Yes15926.757.2100.0 Total27846.7100.0 MissingSystem31753.3 Total595100.0

19. Satisfaction with Job Frequency Valid Percent Cumulative Percent Very satisfied12635.1 Satisfied14440.175.2 Dissatisfied6016.791.9 Very dissatisfied298.1100.0 Total359100.0

20. Overall Satisfaction

21. Ability to Reach Counselor

22. Time to Receive Services

23. Treatment by Reception Staff

24. Treatment by Counseling Staff

25. Job Choice and Skills Matched

26. Understanding Services

27. Participation in Planning Services

28. Planning for Job or Training

29. Informed about Hearing

30. Recommend VESID

31. Employment Forecasts for State VR Agencies Develop a prediction model to forecast the employment of people with disabilities Work with officials from the Iowa VR, Iowa DOL, and Iowa SSA to develop a prototype of the VR State Plan section dealing with future needs Apply to Assessment of One-Stop Performance Apply to Services for Ticket Holders Apply to Transitioning Services Apply to State Budgeting Process 31

32. Forecasting Available Labor Force Employment By Industry Employment By Occupation Employment By Firm Size Occupational Wage Estimates Unemployment Rates Available Jobs Per Worker 32

33. Forecasting for Consumers We will adapt this work to address the employment of people with disabilities by integrating existing data sources that have not been effectively integrated before and used for state-level planning and program development 33

34. Disability Data Sources Census Bureau Rehabilitation Services Administration Social Security Administration Federal Department of Labor 34

35. Result An improved mechanism by which state VR agencies can develop plans and budgets based on sound data and identified areas where promising practices might be implemented. This would enable agencies to better target unserved and underserved populations and direct outreach to regions and employment sectors with greater hiring potential.It can be adapted to transition planning for youth with disabilities. 35

36. Comprehensive Statewide Needs Assessment Model 36 Review of Literature Analysis of Extant Data Key Informant Interviews Focus Group Random Survey (Interview) Implementation Planning VR SYSTEM Resource Assessment

37. Toward Evidence-Based Practices Dependent Variables Current Consumer Satisfaction Satisfaction At Closure Follow-Up Satisfaction Casefile Data Moderating Variables Forecasting Model Collaboration Independent Variables Promising Practices Grant Applications and External Evaluation

38. Online Training Partnerships A virtual classroom, DigitalChalk, that allows learners to adapt the learning portal to their learning needs, including a note taking capability It utilizes synchronized audio, video, power point presentations, downloadable documents, learning assessments, and certification credentialing Closed captioning can be turned on/off from portal The training can be accessed at any time and at the learners’ desired pace ESSRTC can assist agencies in designing best practice training 38

39. Disability Stats RTC Five year project funded by NIDRR Hunter College lead agency Partners New Editions Mathematica Policy Research Center for Essential Management Services 39

40. Mission The Rehabilitation Research and Training Center on Disability Statistics and Demographics (StatsRRTC) will facilitate evidence-based decision making in many different service and policy arenas to benefit persons with disabilities, leading to improved education and employment outcomes 40

41. VR Data Processes & Analyses Utilizes a combination of formats, including workshops, conferences, the DigitalChalk Learning Platform, and our Webinar Series to work with the 80 general and blind vocational rehabilitation (VR) state agencies. 41

42. VR Data Processes & Analyses Yr 1 Develop network of VR state agency personnel with focus on data, research and evaluation Conduct assessment of their needs regarding disability data/statistics Collect information on their current data collection, analysis and reporting practices 42

43. 43 VR Data Processes & Analyses Yr 2 Inquire into evidence regarding validity and reliability of these data collection processes Coalesce these practices into a “menu of practices” that documents the different data collected and how they are used Develop a set of promising practices based on what we observe in the field. Field test these practices

44. 44 VR Data Processes & Analyses Yrs 3-5 Convey the menu and promising practices back to the agencies (State of Science) In collaboration with the training participants, develop plans for future research aimed at improving data collection, analysis, and reporting.