1. Geoff Grove & Melissa Maynard July 2017
ACTE 2017-CTE Data
Geoff Grove & Melissa Maynard
July 2017

2. Who is a CTE Participant?
A student who has earned credit in a CTE course.
Enrolled in a CTE course meets all business rules
Subject/course code, curriculum approved – hours – program matrix
Valid CTE teacher license

3. Who is a CTE Concentrator?
A student who has completed half of a CTE Workforce Development Program and has enrolled in the next portion of the same CTE program.
Reported by districts POC has to align to approved subject code.
“One Day?” use best judgment

4. Who is a CTE Concentrator Who Left Secondary Education?
A secondary student who got reported in EMIS as a CTE Concentrator, and who no longer is enrolled in secondary education.
Does not mean that the student graduated.
Does not mean they left the district. Can show up a year or two later.

5. What data do we measure?
Academic Achievement – Reading Academic Achievement – Math Technical Skill Attainment Secondary School Completion Graduation Placement Nontraditional Participation Nontraditional Completion Prep For Success End of Course Exams Credentials
Ever passed measures OGT – CLS how many passed
GEDs included – was diploma now GED
Placement – working to improve tracking with workforce development
Grad requirements GW need detail

6. Where does the data show up?
Federal and State Accountability Systems Consolidated Annual Report for Perkins/Perkins Accountability CTE Report Card Quality Data Review
Data to Feds reported end of each year –

7. Alignment
Funding Validation of Program of Concentration Technical Assessment Requirements
The alignment is determined by the FY Program Matrix and the FY Assessment Matrix.
These are revised annually.

8. How do I Check for Alignment?
CTE Program Matrix CTE Assessment Matrix

9. CTE Program Matrix

10. CTE Assessment Matrix

11. Where Can I Find the Program Matrix?
On the ODE CTE page
Or search ‘Program Matrix’ on ODE page

12. Where Can I Find the Assessment Matrix?
On the ODE CTE page
Or search ‘Assessment Matrix’ on ODE page

13. ODE CTE Report Card

14. Upcoming Changes in 2017 New industry credential measure.
End of course exams as part of Technical Achievement Grade.
Enrollment.
Breakdown of post-placement categories.
Scheduled industry credential grade will not occur for FY17.

15. Graduation Component
60/40 weighting schema approved for school/district report card Same weighting recommended for the CTE report card

16. Graduation Component

17. Graduation Component Grade Assignment
Points
Letter Grade
4.125 – 5.000 A
3.125 – 4.124 B
2.125 – 3.124 C
1.125 – 2.124 D
0 – 1.124 F
Measure
Weighted Points
Component Points
4-Year Rate
95.2% = 4.5 Points x 0.60 weight
2.7 Points
5-Year Rate
92.0% = 3.5 points x 0.40 weight
1.4 Points
Total
4.10 points = “B” Component grade

18. Achievement Component
Currently contains only Technical Skill attainment New: Academic indicators in 2017 Committee recommended in 2013 that academics be integrated once EOC tests were implemented

19. Technical Skill Grading Schema 2016 and Beyond
Original
Grade
Technical Skill Attainment Rate A
90% - 100% B % C
70% % D
60% % F
< 60%
Promotion/ Demotion
Participation Rate
Grade Demotion
<=90%
Second Demotion
Below 80%

20. Indicators
Will include indicators for EOC tests for students participating in CTE and taking EOC during the school year Targets and grading scale aligned to district report card Implement in 2017

21. 2016-2017 High School Indicators
Academic Indicators
High School Indicators
Algebra I EOC
American History EOC
American Government EOC
English I EOC
English II EOC
Geometry
Integrated Math I
Integrated Math II
Physical Science
Biology

22. Achievement Component
Weighting for 2016:
100% Technical Skill Attainment
Weighting for 2017 and beyond:
75% Technical Skill Attainment
25% Academic Indicators

23. Post Program Outcomes
Post-Program Measure Industry Credentials of at least 12 pts. New-Percent who have obtained and Industry Credential

24. Post Program Outcomes Weighting for 2016: 100% Placement
Weighting for 2017 and beyond:
75% Placement
25% Industry Credentials

25. Prepared for Success
College Admission Test (ACT, SAT) Dual Enrollment Industry Credentials Honors Diploma Advanced Placement and International Baccalaureate

26. Prepared for Success
Measures how well a school or district is doing to prepare students for college and careers 6 ungraded measures that become a graded component

27. 2016 Prepared for Success Component Grade
By law the component is tied to the four-year and five-year graduation cohorts
Denominator of each graduation rate calculation is the denominator of Prep. For Success Component

28. Component Framework 4-Year Cohort Denominator +

29. A student must have one of these
Component Framework
To be in the numerator a student must be remediation free, obtain an industry credential, or earn an Honors Diploma Any of these students who also have AP, IB, or post secondary credits will earn a bonus weight of 0.3
Remediation Free
Honors Diploma
Industry Credentials
Advanced Placement
International Baccalaureate
Dual Enrollment
A student must have one of these
Bonus points if a student has one of these AND has one of the first three

30. Prepared For Success Example
Student
Students Count 1.0 in Numerator with One of More of These*
Students in Numerator Earn 0.3 Bonus Weight with One of More of These*
Total Points for Student
ACT/SAT Remediation Free
Honors Diploma
Industry-Recognized Credential
AP Test
3 or Higher
IB test
4 or Higher
Three or More College Credits
Student 1
YES No
1.3
Student 2 1
Student 3
Student 4
Student 5
Student 6
Student 7
Student 8
Student 9
Student 10
TOTAL POINTS EARNED
7.2

31. Prepared for Success Component Grade Scale - 2017
Range A
90% - 100% B
70% % C
45% % D
25% % F
0% %
The FY17 scale has increase from FY16 and will increase again in FY18.

32. Prepared for Success Component Grade Scale – 2018 & Beyond
Range A
93% - 100%* B
75% % C
60% % D
40% % F
0% %
*The percentage for the “A” range aligns to the four-year graduation rate

33. Overall grade Coming in 2018 Proposed Weighting: Feedback Welcome
Achievement and Post Program 30% each
Graduation and PFS 20% each
No overall A unless all Perkins targets met
Feedback Welcome

34. ODE CTE Report Card -Federal

35. CTE Report Card Download File
Download Data
Select Year
Career Technical Planning District
CTE Summary – grades of all CTPD
CTE Ratings details of indicators

36. CTE Report Card Documentation
From the Report Card Page:

37. Quality Program Review
FY17 Data
Same cohort as FY17 Report Card
Goal is to be released same time as CTE Report Card September 2017
Review of Report Card data also review of program level
Take them to the safe account to see the data and manual.

38. Gen Issues and Reports
In FY17, gen issues and reports were run prior to and during the MarchD window.
Reports were delivered via the Report Collector.
Reports were at the district and CTPD level.
Timing is critical during the MarchD window.

39. Reporting Items to Review
Industry Credentials (GW)
Technical Assessments
Program of Concentration

40. Industry Credentials
Industry Credentials will be reported with a score.
Industry Credentials are being used in different measures on the traditional report card and CTE report card.
The valid FY Industry Credential list and the EMIS Manual will show different Industry Credentials.

41. Industry Credential
EMIS Manual not the source for the approved list for the FY Source for valid credentials is Web page A student’s list is “set” as of when the student first enters the 11th grade.

42. Technical Assessments
Will be WebXam or Industry Credentials.
Must have score reported.
The aligned technical assessment will be transitioning to the subject code level.

43. Program of Concentration
Program of Concentration is determined in the 3rd window. Example: 20173STRD.
Validate data
Reduce appeals
Ensure alignment with technical assessments
There were over 2K appeals this past year for program of concentration.
Unfortunately by the time some realized they had the wrong POC due to alignment of technical assessments it is too late to revise the POC.

44. How do you ensure quality data?
Build a data team
Good data isn’t a one person job.
Your EMIS coordinator is your friend.
Monitor ODE reports
Institute best practices for follow-up surveys
Ask questions
Data Managers
EMIS -
Cross functional team
Discuss updates –
Post Placement – contact card parents/friends social media presence

45. Perkins Federal Grant
Proposed revision didn’t make vote before No word if any movement with new administration Potential Concentrator definition change

46. CTE Funding Community School funding pulled this week
Final #1 available August 1st
Reports this week

47. CTE Funding Traditional Schools next week
Final #1 available August 17th
Reports next week

48. Additional checks for FY18
CTE Funding Reports
All existing checks
New ones added SC00014 and SC00015
Additional checks for FY18

49. New Error Checks - draft
SC0014
A course by course check of the CTE FTE generated in comparison to the regular FTE generated. If the course CTE FTE is higher than the regular FTE, then the CTE FTE is reduced. Please review the Course Dates, hours of instruction of the course, the students' assigned calendar and percent of time reported to ensure accuracy.
SC0015
All CTE courses are proportionally reduced-down to the total regular FTE amount, as the CTE FTE cannot be higher than the regular FTE generated. Ensure the Course Dates, hours of instruction of the course, the students' assigned calendar and percent of time reported are accurate and align to the other entity(ies) reporting the student.

50. CTE Funding – Student Appeals
Student appeal window to open 7/31
Some student data could impact CTE Funding
Demographics (Econ Dis) and enrollment percent of time

51. CTE Funding – Student Appeals
Additional district checks
Course enrollment and POC alignment

52. CTE Funding – Funding Appeals
Funding appeal window to open September
Funding complete by end of calendar year
Provide detail information in appeals

53. CTE Funding FY18 Redesigning CTE process
More timely reports and information
What information would be helpful?

54. Upcoming EMIS Windows CTE Assessment Window August
Checks alignment to POC
Close in October

55. Upcoming EMIS Windows FY18 Calendar August
Initial Community School information soon
Public student level September

56. EMIS Changes Graduation Requirments
Discussion of new data elements in process
Communication from EMIS coming soon

57. CTE Data Management Staff
Geoff Grove
Melissa Maynard