1. CTE Data and EMIS Update
Geoff Grove December 2016

2. Overview
CTSO Level of Participation College Credit Plus Credential and Assessment Reporting Changes EMIS Processing Schedule

3. Funding Appeals Reports Upcoming EMIS Changes
Overview
Funding Appeals Reports Upcoming EMIS Changes

4. Who is a CTE Participant?
A student who has earned credit in a CTE course.
Enrolled in a CTE course meets all business rules
Subject/course code, curriculum approved – hours – program matrix
Valid CTE teacher license

5. Who is a CTE Concentrator?
A student who has completed half of a CTE Workforce Development Program and has enrolled in the next portion of the same CTE program.
Reported by districts POC has to allign to approved subject code.
“One Day?” use best judgment

6. What data do we measure? Academic Achievement – Reading
Academic Achievement – Math
Technical Skill Attainment
Secondary School Completion
Graduation
Placement
Nontraditional Participation
Nontraditional Completion
Credentials
Ever passed measures OGT – CLS how many passed
GEDs included – was diploma now GED
Placement – working to improve tracking with workforce development
Grad requirements GW need detail

7. Where does the data show up?
Federal and State Accountability Systems
Consolidated Annual Report for Perkins/Perkins Accountability
CTE Report Card
Data to Feds reported end of each year –

8. Career Technical Student Organizations (CTSO)
Capture level of student involvement – Local, Regional, State or National level activities ** Did not participate LC Participated at the local level RG Participated at the regional level ST Participated at the state level NT Participated at the national level

9. Assessment and Credential Reporting Changes
Removal of the GU Assessment Code for FY16
The remaining GU Assessments are also reported as GW
Only Report GW to Avoid Confusion and Duplication

10. Credential Yes/No Flag
Credential Y/N flag removed for FY16 Need 12 point of credentials Report detailed credential information

11. Credential Updates
Updated list on ODE Web site Changes include new credentials, point values, and deletions Search “Industry Recognized Credentials”

13. Credential Updates
EMIS Manual may not be final Source for valid credentials is Web page New format of credentials coming

14. Credential Date
Report date credential earned Needed for Prepared for Success Calculations Credentials can still be reported for concentrators in March(D)

15. Assessment Updates
Updated list on ODE Web site Simplified from previous years Search “Assessment Matrix”

16. EMIS Manual may not be final Source for valid assessments is Web page
Assessment Updates
EMIS Manual may not be final Source for valid assessments is Web page

17. EMIS Processing Schedule
Draft Schedule for updated 12/8 Draft Schedule for posted 12/8 Search “EMIS Schedule” on ODE site

19. Important Dates(12/8 Draft)
Final Staff/Course – 3/7/17 March(D) Follow-up – open 2/13/17 Close 4/28/17

20. Appeals
Will continue in FY17 Appeal Calendar in works Search “Data Appeal” for up to date information

21. Funding
Appeals for FY16 funding still being processed Not set end date JVSDs should receive post appeal report in February

22. Funding
FY17 funding reports planned to start in January First funding reports before close of first staff/course window

23. Other Reports
EMIS reports for MarchD Follow-up Planned to precede open of March window Earlier information longer window will reduce appeals

24. PLTW Certifications
Adjust Certification Checks to Recognize Project Lead the Way and Middle School Validation Reduce Number of Overrides

25. Industry Credential Senior Only Programs

26. Key Stakeholders School districts Career technical planning district
Post-secondary partners
Industry partners

27. Identifying Location of Program
Considerations for selection of site
Greatest student access
Industry Credential facility requirements
Transportation
Location of industry credential programs within the career technical planning district
Role of industry and postsecondary partners

28. Career Technical Education Supplemental Funding
Category Career Technical Education Supplemental Funding
Category 1
Agriculture & Environmental Systems, Construction Technologies, Engineering & Science Technologies, Finance, Health Science, Information Technology, Manufacturing Technologies
Category 2
Business & Administration, Hospitality & Tourism, Human Services, Law & Public Safety, Transportation Systems, Arts & Communications
Category 4
Education & Training, Marketing, Public Administration
Category 3 – CBI
Category 5 - FSC

29. Teacher Certification
Two Requirements
Maintain current industry credential
Proper Teacher License
Career Technical Education
Professional
12-Hour Teaching Permit
How to identify potential educators for these programs?
Survey teachers in district;
Work with career technical planning district to identify a potential career center educator;
Survey community business leaders

30. Senior Only Credential Coding
First Numbers of Subject Code 38XXXX ASE Collision Repair B2 – CH42 Sr. Only subject code 38CH42

31. Questions?

32. CTE Data Management Staff
Geoff Grove
Kim McKeand
Melissa Maynard

33. ODE CTE Report Card

34. CTE Report Card Timeline
CTE Report Card approved via Board Resolution Board Resolution needed to implement component and overall grades Alignment with school/district report card

35. Upcoming Changes for 2016 and beyond
Component Grades
Prepared for Success component grade
Achievement component grade
Addition of Academic Indicators
Post Program Outcomes component grade
Industry Credentials measure
Graduation component grade

36. Report Card Resources
All indicators and components documented Search “Report Card Resources”

37. Graduation Component
60/40 weighting schema approved for school/district report card Same weighting recommended for the CTE report card

38. Graduation Component

39. Graduation Component Grade Assignment
Points
Letter Grade
4.125 – 5.000 A
3.125 – 4.124 B
2.125 – 3.124 C
1.125 – 2.124 D
0 – 1.124 F
Measure
Weighted Points
Component Points
4-Year Rate
95.2% = 4.5 Points x 0.60 weight
2.7 Points
5-Year Rate
92.0% = 3.5 points x 0.40 weight
1.4 Points
Total
4.10 points = “B” Component grade

40. Achievement Component
Currently contains only Technical Skill attainment New: Academic indicators in 2017 Committee recommended in 2013 that academics be integrated once EOC tests were implemented

41. Technical Skill Grading Schema 2016 and Beyond
Original
Grade
Technical Skill Attainment Rate A
90% - 100% B % C
70% % D
60% % F
< 60%
Promotion/ Demotion
Participation Rate
Grade Demotion
<=90%
Second Demotion
Below 80%

42. Indicators
Will include indicators for EOC tests for students participating in CTE and taking EOC during the school year Targets and grading scale aligned to district report card Implement in 2017

43. 2016-2017 High School Indicators
Academic Indicators
High School Indicators
Algebra I EOC
American History EOC
American Government EOC
English I EOC
English II EOC
Geometry
Integrated Math I
Integrated Math II
Physical Science
Biology

44. Achievement Component
Weighting for 2016:
100% Technical Skill Attainment
Weighting for 2017 and beyond:
75% Technical Skill Attainment
25% Academic Indicators

45. Post Program Outcomes
Industry Credentials included in Prepared for Success Feedback from the field as well as internal analysis suggests denominator for measure should only include students in programs with aligned credentials available More data needed – implement in 2017

46. Post Program Outcomes Weighting for 2016: 100% Placement
Weighting for 2017 and beyond:
75% Placement
25% Industry Credentials

47. Report Card Components
Prepared for Success
College Admission Test
Dual Enrollment
Industry Credentials
Honors Diplomas
Advanced Placement and International Baccalaureate

48. Prepared for Success
Measures how well a school or district is doing to prepare students for college and careers 6 ungraded measures that become a graded component

49. Prepared for Success
In 2015 and beyond all data is reported in EMIS versus using outside data sources Denominator for each measure is the 4-year and 5-year cohort

50. 2016 Prepared for Success Component Grade
By law the component is tied to the four-year and five-year graduation cohorts
Denominator of each graduation rate calculation is the denominator of Prep. For Success Component

51. Component Framework 4-Year Cohort Denominator +

52. A student must have one of these
Component Framework
To be in the numerator a student must be remediation free, obtain an industry credential, or earn an Honors Diploma Any of these students who also have AP, IB, or post secondary credits will earn a bonus weight of 0.3
Remediation Free
Honors Diploma
Industry Credentials
Advanced Placement
International Baccalaureate
Dual Enrollment
A student must have one of these
Bonus points if a student has one of these AND has one of the first three

53. Prepared For Success Example
Student
Students Count 1.0 in Numerator with One of More of These*
Students in Numerator Earn 0.3 Bonus Weight with One of More of These*
Total Points for Student
ACT/SAT Remediation Free
Honors Diploma
Industry-Recognized Credential
AP Test
3 or Higher
IB test
4 or Higher
Three or More College Credits
Student 1
YES No
1.3
Student 2 1
Student 3
Student 4
Student 5
Student 6
Student 7
Student 8
Student 9
Student 10
TOTAL POINTS EARNED
7.2

54. Prepared for Success Component Grade Scale - 2016
Scale increases in each year
2016 Grade
Range A
85% - 100% B
65% % C
34% % D
15% % F
0% %

55. Prepared for Success Component Grade Scale - 2017
Range A
90% - 100% B
70% % C
45% % D
25% % F
0% %

56. Prepared for Success Component Grade Scale – 2018 & Beyond
Range A
93% - 100%* B
75% % C
60% % D
40% % F
0% %
*The percentage for the “A” range aligns to the four-year graduation rate

57. Overall grade Coming in 2018 Proposed Weighting: Feedback Welcome
Achievement and Post Program 30% each
Graduation and PFS 20% each
No overall A unless all Perkins targets met
Feedback Welcome

58. Ran sample data based on 2016 Report Card 2 CTPDs had A 35 CTPDs had B
Overall Grade
Ran sample data based on 2016 Report Card 2 CTPDs had A 35 CTPDs had B

59. ODE CTE Report Card -Federal

60. CTE Report Card Download File
Download Data
Select Year
Career Technical Planning District
CTE Summary – grades of all CTPD
CTE Ratings details of indicators

61. College Credit Plus
New Delivery Method (CN320) to help districts get funding CP- Career Tech College Credit Plus Course Instruction delivered at district with instructor provided by the college/university or with district's own instructor.

62. College Credit Plus
JVS CCP funding report will be complete soon NewsFlash when final then 45 day review process Payment based on who reports CCP course in EMIS

63. College Credit Plus
LEA can flag students who belong to them or wait until end of 45 days If no course reported in EMIS funding divided based on FTE CCP reports for FY16 and fall of FY17

64. Annual Program Review FY2016 Available in Compliance System
FY2016 Career Technical Education Program Review Manual
Launch Date of Compliance System: November 1, 2016
Completion Date of District Self-Review: September
Take them to the safe account to see the data and manual.

65. Annual Program Review FY17 Data Same cohort as FY17 Report Card
Goal is to be released same time as CTE Report Card September 2017
Review of Report Card data also review of program level
Take them to the safe account to see the data and manual.

66. How do you ensure quality data?
Build a data team
Good data isn’t a one person job.
Your EMIS coordinator is your friend.
Monitor ODE reports
Institute best practices for follow-up surveys
Ask questions
Data Managers
EMIS -
Cross functional team
Discuss updates –
Post Placement – contact card parents/friends social media presence

67. Perkins Federal Grant
Proposed revision didn’t make vote before No word if any movement with new administration Potential Concentrator definition change

68. CTE Data Management Staff
Geoff Grove
Kim McKeand
Melissa Maynard