1. New York State Report Cards Program Report Cards Fiscal Year 10/11 Presented by: Rosemary Matt NYS Director of Accountability

2. Evaluated in TWO Methods NYS BenchmarksQuartile Ranked Educational Gain = 46% Post Test Rate = 65% Follow Up Outcomes = 69% Educational Gain (Weighted) Post Test Rate Follow Up Outcomes

3. NYS Quartile Ranking Quartile 1 0 -.99 Unacceptable Quartile 2 1 – 1.99 Needs Improvement Quartile 3 2 – 2.99 Proficient Quartile 4 3 – 4.00 Highly Proficient

4. Quartile Rank Unacceptable – Missed one or more benchmark & in the 1 st quartile Needs Improvement – Missed one or more benchmark & in the 2 nd, 3 rd, or 4 th quartile Proficient – Has met all the benchmarks (any quartile) Highly Proficient – Has met all the benchmarks & in quartile 4

5. An overview of the program:

6. Data from Program Evaluation Report:

7. NYS Benchmark Summary: NYS Benchmarks: Education Gain = 46% Post Test Rate = 65 % Follow-up Outcomes = 69%

8. NYS Benchmark Summary: NYS Benchmarks: Education Gain = 46% Post Test Rate = 65 % Follow-up Outcomes = 69%

9. Post Test Rate: Post Test Rate is also Quartile Ranked

10. Post Test Rate:

11. NYS Benchmark Summary: NYS Benchmarks: Education Gain = 46% Post Test Rate = 65 % Follow-up Outcomes = 69%

12. Where have you seen them before:

13. Follow Up Outcomes: Raw numbers used to calculate Program Performance in Percent # students achieving goal # students exiting with goal = 86.5%

14. Weighted Academic Gain:

15. Goal Setting: 0510

16. Response Rate: 010

17. Quartile Rank Summary: Note: Quartile Rank includes Weighted Educational Gain

18. Overall Performance: Quartiles Quartile 1 0 -.99 Unacceptable Quartile 2 1 – 1.99 Needs Improvement Quartile 3 2 – 2.99 Proficient Quartile 4 3 – 4.00 Highly Proficient

19. Overall Performance: Quartile 1Quartile 2Quartile 3Quartile 4 01234 1.35

20. Rubric for FY10/11: Educational Gain (40%) Follow Up Outcomes (20%) Post Test Rate (20%) Employment & GED Goal Setting (10%) Response Rate (10%)

21. Total Score – Calculations for FY10/11 Maximum rating points to be earned: – Weighted Academic Gain 40 – Follow-up Measures 20 – Post Test Rate 20 – Goal setting 10 – Response Rate 10 – Maximum Total100

22. NRS Changes

23. Change Effective July 1, 2012 OVAE has accepted major change to NRS Guidelines All proposed changes begin July 1, 2012 ASISTS will make changes in data system to begin July 1, 2012

24. 1 st Major Change

25. Let’s compare Current System: Students are assessed at Intake Determination is made: Is student employed __yes __no Is student available for work? __yes __no If YES, then assign the goal of “Obtain Employment” (70% Target) If NO – then student status is coded as “Not in the workforce” Changes to System: Students are assessed at Intake Determination is made: Is student employed __yes __no Is student available for work? __yes __no If YES, then ASISTS will automatically assign the goal of “Obtain a Job” to all students in this cohort If NO – then student status is coded as “Not in the workforce”

26. Current System: Students are assessed at Intake Determination is made: Is student employed __yes __no If YES – is student enrolled in literacy to Retain his/her employment? If YES – code student with goal of “Retain Employment” Changes to System: Students are assessed at Intake Determination is made: Is student employed __yes __no If YES, then ASISTS will automatically assign the goal of “Retain Employment” to all students in this cohort. Program must conduct Follow Up Survey on each student 3 Quarters after student exits the program. Let’s compare

27. 2 nd Major Change

28. Current System: Students are assessed at Intake Determination is made: Does student have the goal of attaining a High School Equivalency Diploma __yes __no If YES, then assign the goal of “Obtain GED” Changes to System: Students are assessed at Intake Determination is made: Programs must report the total number of enrolled students who take all the GED tests during the year and the number who pass them to calculate a pass rate. All GED test data will now be recorded in ASISTS and a pass rate will be calculated for each program. Let’s compare

30. 3 rd Major Change

31. Let’s compare Current System: Students are assessed at Intake Determination is made: Does student have the goal of attaining a High School Equivalency Diploma __yes __no If YES, then assign the goal of “Obtain GED” Second Question – Does the student also have the goal of entering Postsecondary Education or Training? If YES, assign goal (50% target) Changes to System: Students are assessed at Intake Determination is made: All learners who have a GED, a secondary credential, or are enrolled in a class specifically designed for transitioning to postsecondary education (e.g., bridge program, college readiness), as the cohort for which “Entry into Postsecondary Education” must be tracked. Students included in the cohort are those who passed the GED tests or earned a secondary credential while enrolled in adult education, enter with these credentials, or are enrolled in a class specifically designed for transitioning to postsecondary education.

32. Additional Change Entry into Postsecondary Education or Training can occur any time from the time of exit until the end of the following program year.

33. 2 Minor Changes Students’ Highest Educational Level or Degree Attained & Teacher Experience and Certification.

34. Contact Information: Rosemary Matt NYS Director of Accountability Email: Rosemary.Matt@cayuga-cc.edu