Geoff Grove & Melissa Maynard July 2017 ACTE 2017-CTE Data Geoff Grove & Melissa Maynard July 2017

Who is a CTE Participant? A student who has earned credit in a CTE course. Enrolled in a CTE course meets all business rules Subject/course code, curriculum approved – hours – program matrix Valid CTE teacher license

Who is a CTE Concentrator? A student who has completed half of a CTE Workforce Development Program and has enrolled in the next portion of the same CTE program. Reported by districts POC has to align to approved subject code. “One Day?” use best judgment

Who is a CTE Concentrator Who Left Secondary Education? A secondary student who got reported in EMIS as a CTE Concentrator, and who no longer is enrolled in secondary education. Does not mean that the student graduated. Does not mean they left the district. Can show up a year or two later.

What data do we measure? Academic Achievement – Reading Academic Achievement – Math Technical Skill Attainment Secondary School Completion Graduation Placement Nontraditional Participation Nontraditional Completion Prep For Success End of Course Exams Credentials Ever passed measures OGT – CLS how many passed GEDs included – was diploma now GED Placement – working to improve tracking with workforce development Grad requirements GW need detail

Where does the data show up? Federal and State Accountability Systems Consolidated Annual Report for Perkins/Perkins Accountability CTE Report Card Quality Data Review Data to Feds reported end of each year –

Alignment Funding Validation of Program of Concentration Technical Assessment Requirements The alignment is determined by the FY Program Matrix and the FY Assessment Matrix. These are revised annually.

How do I Check for Alignment? CTE Program Matrix CTE Assessment Matrix

CTE Program Matrix

CTE Assessment Matrix

Where Can I Find the Program Matrix? On the ODE CTE page Or search ‘Program Matrix’ on ODE page

Where Can I Find the Assessment Matrix? On the ODE CTE page Or search ‘Assessment Matrix’ on ODE page

ODE CTE Report Card

Upcoming Changes in 2017 New industry credential measure. End of course exams as part of Technical Achievement Grade. Enrollment. Breakdown of post-placement categories. Scheduled industry credential grade will not occur for FY17.

Graduation Component 60/40 weighting schema approved for school/district report card Same weighting recommended for the CTE report card

Graduation Component

Graduation Component Grade Assignment Points Letter Grade 4.125 – 5.000 A 3.125 – 4.124 B 2.125 – 3.124 C 1.125 – 2.124 D 0 – 1.124 F Measure Weighted Points Component Points 4-Year Rate 95.2% = 4.5 Points x 0.60 weight 2.7 Points 5-Year Rate 92.0% = 3.5 points x 0.40 weight 1.4 Points Total 4.10 points = “B” Component grade

Achievement Component Currently contains only Technical Skill attainment New: Academic indicators in 2017 Committee recommended in 2013 that academics be integrated once EOC tests were implemented

Technical Skill Grading Schema 2016 and Beyond Original Grade Technical Skill Attainment Rate A 90% - 100% B 80 - 89.9% C 70% - 79.9% D 60% - 69.9% F < 60% Promotion/ Demotion Participation Rate Grade Demotion <=90% Second Demotion Below 80%

Indicators Will include indicators for EOC tests for students participating in CTE and taking EOC during the school year Targets and grading scale aligned to district report card Implement in 2017

2016-2017 High School Indicators Academic Indicators 2016-2017 High School Indicators Algebra I EOC American History EOC American Government EOC English I EOC English II EOC Geometry Integrated Math I Integrated Math II Physical Science Biology

Achievement Component Weighting for 2016: 100% Technical Skill Attainment Weighting for 2017 and beyond: 75% Technical Skill Attainment 25% Academic Indicators

Post Program Outcomes Post-Program Measure Industry Credentials of at least 12 pts. New-Percent who have obtained and Industry Credential

Post Program Outcomes Weighting for 2016: 100% Placement Weighting for 2017 and beyond: 75% Placement 25% Industry Credentials

Prepared for Success College Admission Test (ACT, SAT) Dual Enrollment Industry Credentials Honors Diploma Advanced Placement and International Baccalaureate

Prepared for Success Measures how well a school or district is doing to prepare students for college and careers 6 ungraded measures that become a graded component

2016 Prepared for Success Component Grade By law the component is tied to the four-year and five-year graduation cohorts Denominator of each graduation rate calculation is the denominator of Prep. For Success Component

Component Framework 4-Year Cohort Denominator +

A student must have one of these Component Framework To be in the numerator a student must be remediation free, obtain an industry credential, or earn an Honors Diploma Any of these students who also have AP, IB, or post secondary credits will earn a bonus weight of 0.3 Remediation Free Honors Diploma Industry Credentials Advanced Placement International Baccalaureate Dual Enrollment A student must have one of these Bonus points if a student has one of these AND has one of the first three

Prepared For Success Example Student Students Count 1.0 in Numerator with One of More of These* Students in Numerator Earn 0.3 Bonus Weight with One of More of These* Total Points for Student ACT/SAT Remediation Free Honors Diploma Industry-Recognized Credential AP Test 3 or Higher IB test 4 or Higher Three or More College Credits Student 1 YES No 1.3 Student 2 1 Student 3 Student 4 Student 5 Student 6 Student 7 Student 8 Student 9 Student 10 TOTAL POINTS EARNED 7.2

Prepared for Success Component Grade Scale - 2017 Range A 90% - 100% B 70% - 89.9% C 45% - 69.9% D 25% - 44.9% F 0% - 24.9% The FY17 scale has increase from FY16 and will increase again in FY18.

Prepared for Success Component Grade Scale – 2018 & Beyond Range A 93% - 100%* B 75% - 92.9% C 60% - 74.9% D 40% - 59.9% F 0% - 39.9% *The percentage for the “A” range aligns to the four-year graduation rate

Overall grade Coming in 2018 Proposed Weighting: Feedback Welcome Achievement and Post Program 30% each Graduation and PFS 20% each No overall A unless all Perkins targets met Feedback Welcome

ODE CTE Report Card -Federal

CTE Report Card Download File Download Data Select Year Career Technical Planning District CTE Summary – grades of all CTPD CTE Ratings details of indicators

CTE Report Card Documentation From the Report Card Page: http://education.ohio.gov/getattachment/Topics/Data/Report-Card-Resources/Sections/Career-Tech-Report-Cards/CTE-Report-Card-Technical-Documentation.pdf.aspx

Quality Program Review FY17 Data Same cohort as FY17 Report Card Goal is to be released same time as CTE Report Card September 2017 Review of Report Card data also review of program level Take them to the safe account to see the data and manual.

Gen Issues and Reports In FY17, gen issues and reports were run prior to and during the MarchD window. Reports were delivered via the Report Collector. Reports were at the district and CTPD level. Timing is critical during the MarchD window.

Reporting Items to Review Industry Credentials (GW) Technical Assessments Program of Concentration

Industry Credentials Industry Credentials will be reported with a score. Industry Credentials are being used in different measures on the traditional report card and CTE report card. The valid FY Industry Credential list and the EMIS Manual will show different Industry Credentials.

Industry Credential EMIS Manual not the source for the approved list for the FY Source for valid credentials is Web page A student’s list is “set” as of when the student first enters the 11th grade.

Technical Assessments Will be WebXam or Industry Credentials. Must have score reported. The aligned technical assessment will be transitioning to the subject code level.

Program of Concentration Program of Concentration is determined in the 3rd window. Example: 20173STRD. Validate data Reduce appeals Ensure alignment with technical assessments There were over 2K appeals this past year for program of concentration. Unfortunately by the time some realized they had the wrong POC due to alignment of technical assessments it is too late to revise the POC.

How do you ensure quality data? Build a data team Good data isn’t a one person job. Your EMIS coordinator is your friend. Monitor ODE reports Institute best practices for follow-up surveys Ask questions Data Managers EMIS - EMIS@education.ohio.gov Cross functional team Discuss updates – Post Placement – contact card parents/friends social media presence

Perkins Federal Grant Proposed revision didn’t make vote before No word if any movement with new administration Potential Concentrator definition change

CTE Funding Community School funding pulled this week Final #1 available August 1st Reports this week

CTE Funding Traditional Schools next week Final #1 available August 17th Reports next week

Additional checks for FY18 CTE Funding Reports All existing checks New ones added SC00014 and SC00015 Additional checks for FY18

New Error Checks - draft SC0014 A course by course check of the CTE FTE generated in comparison to the regular FTE generated. If the course CTE FTE is higher than the regular FTE, then the CTE FTE is reduced. Please review the Course Dates, hours of instruction of the course, the students' assigned calendar and percent of time reported to ensure accuracy. SC0015 All CTE courses are proportionally reduced-down to the total regular FTE amount, as the CTE FTE cannot be higher than the regular FTE generated. Ensure the Course Dates, hours of instruction of the course, the students' assigned calendar and percent of time reported are accurate and align to the other entity(ies) reporting the student.

CTE Funding – Student Appeals Student appeal window to open 7/31 Some student data could impact CTE Funding Demographics (Econ Dis) and enrollment percent of time

CTE Funding – Student Appeals Additional district checks Course enrollment and POC alignment

CTE Funding – Funding Appeals Funding appeal window to open September Funding complete by end of calendar year Provide detail information in appeals

CTE Funding FY18 Redesigning CTE process More timely reports and information What information would be helpful?

Upcoming EMIS Windows CTE Assessment Window August Checks alignment to POC Close in October

Upcoming EMIS Windows FY18 Calendar August Initial Community School information soon Public student level September

EMIS Changes Graduation Requirments Discussion of new data elements in process Communication from EMIS coming soon

CTE Data Management Staff Geoff Grove Geoff.grove@education.ohio.gov Melissa Maynard Melissa.maynard@education.ohio.gov