2. Nevada CTE & CTECS: Programs, Standards, Assessments & Credentials January, 2014 Nevada Department of Education Office of Career, Technical and Adult Education

3. Overview Nevada Department of Education Office of Career, Technical and Adult Education Introduction – History of NV CTE and CTECS partnership Website Course Catalog Program Components CTE Assessments – Workplace Readiness Skills Assessments – End-of-Program Technical Assessments Certificate of Skill Attainment 2013 Assessment Results January, 2014

4. Website Nevada Department of Education Office of Career, Technical and Adult Education Nevada Department of Education CTE Website cteae.nv.gov January, 2014

5. Website Nevada Department of Education Office of Career, Technical and Adult Education January, 2014

6. Website Nevada Department of Education Office of Career, Technical and Adult Education January, 2014

7. CTE Course Catalog Nevada Department of Education Office of Career, Technical and Adult Education Prior to the creation of the catalog CTE courses in Nevada were very scattered, and it was difficult to tell our story and gather data. The creation of the NV CTE Course Catalog was our first step The catalog is organized by program area and career cluster It provides Course Sequencing and Course Descriptions January, 2014

8. Nevada’s CTE Programs Nevada Department of Education Office of Career, Technical and Adult Education Overall CTE Programs and Course Counts: January, 2014 2014-15 CTE Course Catalog Program AreaNumber of ProgramsNumber of Courses Agriculture and Natural Resources1336 Business and Marketing Education643 Education, Hospitality, and Human Services844 Health Science and Public Safety1464 Information and Media Technologies1699 Skilled and Technical Sciences22108 Totals79394

9. Nevada’s CTE Program Nevada Department of Education Office of Career, Technical and Adult Education Each program will have: Program Technical Skill Standards Employability Skills for Career Readiness Standards Program of Study Curriculum Framework Workplace Readiness Skills Assessment End-of-Program Technical Assessment Certificate of Skill Attainment January, 2014

10. Program Completion Requirements 1.Students must complete the sequence of courses as determined by the CTE Course Catalog 2.Where available, students must take an end-of- program technical assessment upon completion of the course sequence 3.Students must be taught the Employability Skills for Career Readiness (21 standards*) and demonstrate proficiency in the employability skill standards *Virginia's Workplace Readiness Standards adopted through the CTECS Consortium. January, 2014 Nevada Department of Education Office of Career, Technical and Adult Education

11. State CTE Skill Standards Identifies content standards, performance standards, and measureable performance indicators Cross-walked to the Common Core State Standards to identify the performance indicators that support academic learning. (ELA, mathematics and science) Cross-walked to the Common Career Technical Core Identifies the body of knowledge to be assessed Drives curriculum development, course sequences, and curriculum frameworks Must be State School Board Approved January, 2014 Nevada Department of Education Office of Career, Technical and Adult Education

12. Skill Standards January, 2014 Nevada Department of Education Office of Career, Technical and Adult Education

13. Employability Skills Standards Nevada Department of Education Office of Career, Technical and Adult Education Employability Skills for Career Readiness – Adopted the 21 standards from Virginia – Virginia conducted a large research project to determine the “soft skills” need to be successful in the workplace – We took them to many groups in Nevada and they were well received. (companies, associations, economic and workforce development groups…) – Included in the instruction of all Nevada CTE Programs – All CTE students in a completion level course will be given the Workplace Readiness Skills Assessment January, 2014

14. Standards Development Protocols Business and Industry Validation Process: 8 Member Writing Team12 Member Writing Team 3– Business/Industry5 – Business/Industry 3 – Secondary 5 – Secondary 2 – Postsecondary OR Industry review panel established and implemented; OR Standards are written to nationally recognized industry standards. January, 2014 Nevada Department of Education Office of Career, Technical and Adult Education

15. January, 2014 Nevada Department of Education Office of Career, Technical and Adult Education

16. Curriculum Framework Nevada Department of Education Office of Career, Technical and Adult Education Document that indicates which performance standard should be taught at each course level in a program sequence. January, 2014

17. CTE Assessments Nevada Department of Education Office of Career, Technical and Adult Education Measurement of skill attainment directly aligned to state standards – completion level courses only Levels = L2C, L3C, and L4C (found in the Nevada CTE Course Catalog) Validates quality of programs based on state standards Allows for the collection of accurate student skill attainment data January, 2014

18. CTE Assessments Test Creation Process (CTECS System) – Revise or create standards Standards writing team – NV Teachers & Industry Representatives – Criticality surveys – Industry Representatives only – Create assessment Assessment writing team – NV Teachers & CTECS – Pilot assessment – Item analyses (Review pilot results and issues) – Live testing – Cut score development (Modified-Angoff Method) Available results: student level, site level, district level, and state level – Biggest asset is that data can be filtered in various ways January, 2014 Nevada Department of Education Office of Career, Technical and Adult Education

19. Test Development Nevada Department of Education Office of Career, Technical and Adult Education Test Creation Process – Revise or create standards Standards writing team – NV CTE Teachers (Nomination from District Representative) – Business and Industry Representatives – Department of Education Representative – Criticality survey of standards (over 400 individuals participated in 2012-2013) Business & Industry rates each performance indicator as Nice to Know, Need to Know, and Needed for Survival January, 2014

20. Test Development Nevada Department of Education Office of Career, Technical and Adult Education – Test Creation Assessment writing team – NV CTE Teachers – CTECS Representatives – Department of Education Representative CTECS provides possible test questions to start with – Team can adopt, adapt, or create new questions – Team will align questions with each performance indicator – Emphasis will be placed on the Needed for Survival performance indicator from the criticality surveys January, 2014

21. Test Development Nevada Department of Education Office of Career, Technical and Adult Education – Pilot the assessment Schools are asked to participate in the pilot tests Assessments are online, 100 multiple-choice questions, and are timed for 60 minutes – Item analysis Assessment writing team Review pilot results Review each question and responses for validity Correct any issues for spring administration January, 2014

22. Test Development Nevada Department of Education Office of Career, Technical and Adult Education – Spring Tests (accommodations are available if required – IEP/504/ELL) ALL Completers must participate (NAC 389.800) Each site will have a Test Coordinator (administrator) Test Administrators (proctors) of testing CAN NOT be related program instructors CTE Assessments are included in the NV Testing Administration Manual (HSPE regulations / test protocol / test security) Teachers need to attend their school’s annual test security training (HSPE). January, 2014

23. Test Development Nevada Department of Education Office of Career, Technical and Adult Education – Cut Score Setting Score determined by the “Modified-Angoff Method” – It is not a norm-referenced method, when a candidate’s pass or fail status is determined by his or her performance in relation to other candidates. Using the Angoff procedure, once the passing point is determined, a candidate’s pass/fail performance is established independently of the group who sat for the exam. Candidates are judged by comparing their performance to an absolute standard, not to other candidates. Theoretically, all candidates can pass or all can fail. January, 2014

24. End of Program Technical Assessments Year 1, 2012: 7 program assessments – 7 new assessments implemented (642 students) Year 2, 2013: 32 program assessments – 25 new assessments implemented (2,557 students) Year 3, 2014: 55 program assessments – 23 new assessments implemented (5,000+ students) Nevada Department of Education Office of Career, Technical and Adult Education January, 2014

25. CTE Assessments 2012-13 55% of Program Completers Assessed 2013-14 80-85% of Program Completers to be Assessed (Projected) * Estimated program completers for 2013-14: 5,200 – 5,800 *Program completers identified by completion level courses only in the 2013-14 CTE Course Catalog (Course Levels L2C, L3C or L4C) Nevada Department of Education Office of Career, Technical and Adult Education January, 2014

26. CTE Assessments Strategies for success: Included in the Nevada Proficiency Examination Program Procedures Manual Added the testing requirements to the NAC Created a Test Administrator Manual Created a Coordinator Manual Provided on-site training for E-SESS usage. Have one contact person for assessments (with a backup) Unresolved Issue: Retake Policy – (suggestions and ideas) Nevada Department of Education Office of Career, Technical and Adult Education January, 2014

27. Certificate of Skill Attainment To earn this certificate, the student must: – Complete the CTE course sequence (as per the CTE Catalog) with a 3.0 GPA or higher – Pass the workplace readiness skills assessment – Pass the end-of-program technical assessment 2012-13 Results – 2,924 students eligible / approximately 700 issued Future Alignment: – Articulation credits will be aligned with a student earning the certificate of skill attainment January, 2014 Nevada Department of Education Office of Career, Technical and Adult Education

28. Certificates Nevada Department of Education Office of Career, Technical and Adult Education January, 2014

29. 2013 Results Data Nevada Department of Education Office of Career, Technical and Adult Education January, 2014 Workplace Readiness Skills Assessment State of Nevada CTE Registered - 5296 Participated - 4790 Passed – 3493 Participation Rate – 90.4% Passing Rate – 72.9%

30. 2013 Results Data Nevada Department of Education Office of Career, Technical and Adult Education End-of-Program Technical Assessments State of Nevada CTE Registered - 2924 Participated - 2557 Passed – 1035 Participation Rate – 87.4% Passing Rate – 40.5% January, 2014

31. Questions / Comments Nevada Department of Education Office of Career, Technical and Adult Education Nevada Department of Education Office of Career, Technical and Adult Education Alex KyserSue Poland Skilled and Technical SciencesAgricultural & Nat. ResourcesEducation Programs Professional (775) 687-7290(775) 687-7281 akyser@doe.nv.govspoland@doe.nv.gov January, 2014