Presentation is loading. Please wait.

Presentation is loading. Please wait.

Student Certification Assessment System (SCAS)

Similar presentations


Presentation on theme: "Student Certification Assessment System (SCAS)"— Presentation transcript:

1 Student Certification Assessment System (SCAS)
Overview

2 Agenda NAFTrack and SCAS Requirements Benefits Components Materials
Participation Award Process Questions Welcome to this Overview webinar on Using the Student Certification Assessment System. Even though it is just an overview, we have a lot of ground to cover in one hour and I do want to have some time to respond to questions you type in or raise your hand to ask. If I miss a question you type in I will read it in the log and repeat it and answer it in an after the webinar at the same time that I send you the presentation slides.

3 NAF’s Proven Model for College and Career Readiness
1. Sequenced series of experiences that cover career awareness, exploration, and preparation 2. Culminate in a compensated internship 3. Students engage directly with professionals 1. Hands-on learning through projects 2. Emphasis on literacy 3. Industry-vetted courses and assessments 1. Personalized learning environment 2. Open to all students 3. Teacher collaboration and professional development 1. Link to community and local businesses 2. Generate internship and work-based learning opportunities 3. Access to industry trends for teachers and students Work- based Learning Curriculum and Assessment Academy Structure The NAF Student Certification Assessment System (SCAS, pronounced “es-cass”) is built on and intended to help measure and strengthen the effectiveness of NAF’s proven model for college and career readiness. Advisory Board 1

4 Overview Student Certification Assessment System Overview
The main purpose of NAF’s Student Certification Assessment System (SCAS) is to certify students as college and career ready with special emphasis in a broad career field represented by one of NAF’s career academy themes (Engineering, Finance, Health Sciences, Hospitality and Tourism, and Information Technology). NAF’s definition of college and career ready, illustrated in this slide, includes: Core Academics include academic content knowledge (e.g. English, mathematics, science, history, arts) and post-secondary context knowledge (admissions requirements, affording college, and different college types) Career Knowledge includes career content knowledge (e.g. knowledge specific to the profession) and career context knowledge (e.g., pathway requirements and qualifications) Foundational Skills include Critical and systemic thinking and problem solving, Information literacy, Creativity and Innovation, Organizational/technology skills, Time management, Flexibility and adaptability, Communication (oral and written, listening and observation) Interpersonal Skills include Collaboration and teamwork, Ethical behavior, Ability to work with diverse individuals Self-Management includes Awareness of one’s own abilities and performance, Self-directed; takes initiative; resourcefulness The SCAS measures college and career readiness using multiple course-based assessments and an internship assessment. The course-based assessment components include end of course exams and culminating project assessments. The culminating project assessment and internship assessment are rubric-based performance assessments that measure application of academic and career knowledge and the cognitive and non-cognitive skills needed to

5 What SCAS is… Student Certification Assessment System – SCAS
A Rigorous Certification A Secure Assessment Program A Measurement of College and Career Readiness Aligned with Industry Standards Designed with National Curriculum and Assessments Experts Developed with NAF Network Input Earning NAF student certification through SCAS requires the successful completion of end of course (EOC) exams and culminating project assessments for certification (CPAC) in four NAF semester-length courses, and successful completion of an internship. Due to local course configuration differences and specific joint certification pathways with industry groups, this may look different in different states. NAF student certification also requires meeting local high school graduation requirements at the level required for admission to the state’s public colleges and universities.

6 What SCAS is NOT… A Learning Management System
A District Student Information System (SIS) A Student Portfolio A Lesson Planning Tool A Formative Classroom Assessment Karlene

7 SCAS By The Numbers… Number of Academies in which students completed one or more CPACs, EOCs, or Internship Assessments (IAs): 9/12 - 2/14 AOF 40 academies AOHT 26 Academies AOIT 20 Academies AOE 6 Academies Karlene You are not alone…….. Had students complete one or more CPACs, EOCs, or Internship Assessments (IAs): 9/12 - 2/14 States – 18 Districts – 22

8 SCAS By The Numbers… Number of Culminating Projects (CPAC), End of Course (EOC) Exams, or Internship Assessments completed in SCAS in 2014. Karlene

9 SCAS By The Numbers… Number of unique students started an assessment in SCAS during the 2013/2014 school year. – 3,130 An update - this is an increase of 774 or about 70% increase in student use.

10 SCAS Requirements Graduation Pass 4 NAF Courses **
Pass 4 Culminating Project Assessments Pass 4 End of Course Assessment Pass Internship Assessment ** 2 year-long third party

11 SCAS Requirements… NAF Student Certification is issued upon graduation to a student who has: Met all local high school graduation requirements at a level required for admission to its state’s public postsecondary institutions (four-year, two-year, and community colleges).

12 SCAS Requirements… NAF Student Certification is issued upon graduation to a student who has: Completed four (4) NAF courses Received a passing score on each of the four (4) culminating projects and four (4) end of course exams, or end of course exams in 2 year-long courses in the case of AOE or some AOHS Passing Score 24 – 40 on NAF end of course exams NAF Student Certification is issued upon graduation to a student who has: Completed four (4) NAF courses receiving a passing score on each of the four (4) culminating projects and end-of-course exams or end of course exams in 2 year-long courses in the case of Engineering, Received a satisfactory rating on the internship assessment. Met all local high school graduation requirements at a level required for admission to its state’s public postsecondary institutions (four-year, two-year, and community colleges). The following are determined to be the SCAS pass/fail scores: End of Course Exams Passing Score – Raw Score Range: 24 – 40 Failing Score – Raw Score Range: 0 – 23 Culminating Project Assessment for Certification (CPAC) The students are expected to submit two work samples and a final product, as denoted throughout each course. Without the two work samples and final product, as well as the reflections, the evidence required for certification assessment is incomplete and the student score for the culminating project must be Insufficient Evidence or 0. The CPAC is comprised of three dimensions and an overall score. Evidence of content knowledge Evidence of awareness of own abilities and performance Evidence of contribution and collaboration Overall Score Students must receive an overall score of 3 or 4, and not receive a score of 0 or 1 in any single dimension.

13 SCAS Requirements… NAF Student Certification is issued upon graduation to a student who has: Received a satisfactory rating on the internship assessment. Internship Assessment Students must receive a performance level of 2, 3, or 4 within each dimension; and Students must meet or exceed expectations on a majority of the dimensions in the four categories; and Students must be rated as “Meets Expectations/Usually” (3) or “Exceeds Expectations/Always” (4) on a set of dimension deemed “high value:”    Part IA3. Critical Thinking – Foundational Skills Part IB4. Teamwork/Collaboration – Applied Workplace Skills Part IC9. Exhibits responsible and professional behaviors – Self-Management and Personal Responsibility, Part II4. Knows how to interact with supervisors, clients, and teammates – Knowledge of the Field and Organizational Context

14 SCAS Benefits… NAFTrack: Certified Hiring Students – Tangible Feedback
Teachers – Strengthen Alignment To Industry Vetted Curriculum Business – Prepared Workforce Post Secondary - Completed Rigorous Course of Study SCAS Benefits While fostering consistent implementation of the NAF curriculum, internships, and assessments, SCAS has clear benefits: Students gain tangible, meaningful feedback regarding knowledge and skills required for success, as well as obtain an industry-certified NAF SCAS certificate upon graduation. Teachers target instruction using evidenced-based decisions, strengthen alignment to the NAF industry vetted curriculum, and address accountability requirements for career and technical skill attainment. Businesses are assured that NAF SCAS Certified students are prepared to enter the workforce and confident that each student has the foundational, applied workplace, and self-management skills as well as the contextual knowledge that contribute to college and career success. Post-secondary institutions will know that students have successfully completed a rigorous and challenging course of study. Success in the NAF Curricula and SCAS certification is a strong sign of a student’s readiness for post-secondary degree or certification program. NAF is in the process of establishing memoranda of understanding with more than 60 colleges and universities who agree to recognize NAF academy graduates who have earned SCAS Certification as they apply for admission and advanced credit. Click on this link for more information NAF partners with national businesses that value NAF’s rigorous preparation for college and career and grant a preferred hiring status for those NAF academy graduates who earned the NAF SCAS Certificate. Click on this link for more information about NAF Track: Certified Hiring

15 NAFTrack Certified Hiring
Initial Program Benefits May Include Pre-interview and resume support College internship opportunities and connectivity Support to ensure more NAF Certified Graduates attend the postsecondary institutions where they recruit Guaranteed interviews in equally qualified applicant pools Potentially expedited advancement in the hiring process Priority hiring among equally qualified applicant pools Applicant feedback and coaching post interview Potential higher starting salary for NAF certified graduates

16 Student Certification Assessment System Internship Assessment
Culminating Project Assessments End of Course Exams Internship Assessment The SCAS measures college and career readiness using multiple course-based assessments and an internship assessment. The course-based assessment components include end of course exams and culminating project assessments. The culminating project assessment and internship assessment are rubric-based performance assessments that measure application of academic and career knowledge and the cognitive and non-cognitive skills needed to succeed in both college and career.

17 SCAS Components Course Assessments =
Culminating Project Assessment for Certification (CPAC) AND End of Course (EOC) Kevin – SCAS represents a multi-method approach to assessing a broad range of content and skills through rigorous end-of-course exams and culminating project assessments combined with supervisor and teacher feedback. SCAS efficiently supports multiple assessment methodologies by combining multiple-choice and constructed-response assessments with performance-based tasks (e.g., classroom-embedded activities, internships). Specifically, the SCAS consists of the following major components: End-of-Course Assessment – Includes a Culminating Project Assessment for Certification (CPAC) and an End of Course (EOC) exam that assess the scope of knowledge and skills across NAF courses. Supervisor Assessment of College and Career Readiness (SACCR) - An internship is the culminating work-based learning experience and the summative assessment for purposes of NAF certification. At the end of a qualified culminating work-based learning experience, a student’s direct supervisor completes the Internship Assessment.

18 Culminating Projects Most NAF-developed courses have culminating projects All culminating projects features: Stages: Planning, Implementation, Final Reflection Questions Final Product Teachers score CPAC Rubric The possibility of including this type of performance assessment in our SCAS is due to the fact that all NAF developed courses have culminating projects with a similar structure.

19 Culminating Project Planning and Implementation Products
Planning and Implementation products that can be uploaded to the SCAS by students

20 Culminating Project Final Products
Final Products to be uploaded to the SCAS by students

21 Culminating Project Reflection Questions
What ideas, concepts, and skills from the specific learning objectives did you apply while developing this work? How does the work sample you selected demonstrate your understanding and application of the ideas, concepts, and skills from the specific learning objectives you mentioned above? These questions or reflection prompts are the same for every course and every theme. Even though the primary purpose of the SCAS is certification, the process of having students answer these reflection questions three times during each culminating project is probably the most powerful part of the SCAS for actually strengthening the learning of students as they participate. When students are informed at the very beginning of the project that the project is part of the certification assessment, and that to be successful, they must complete each step, upload work samples and answer reflection questions, and they are given the reflection questions and certification assessment rubric, Then Students will see and understand the big picture of each culminating project as a stepping stone and an opportunity to hone the skills that they will need to be successful in pursuing postsecondary certificates and degrees, and in pursuing a career. When students know expectations, they rise to the challenge!

22 Culminating Project Reflection Questions
Describe the quality of your work sample in relationship to the specific learning objectives. Describe what you could improve about your work sample. Describe how you contributed to the development of the selected work sample. These questions or reflection prompts are the same for every course and every theme. Even though the primary purpose of the SCAS is certification, the process of having students answer these reflection questions three times during each culminating project is probably the most powerful part of the SCAS for actually strengthening the learning of students as they participate. When students are informed at the very beginning of the project that the project is part of the certification assessment, and that to be successful, they must complete each step, upload work samples and answer reflection questions, and they are given the reflection questions and certification assessment rubric, Then Students will see and understand the big picture of each culminating project as a stepping stone and an opportunity to hone the skills that they will need to be successful in pursuing postsecondary certificates and degrees, and in pursuing a career. When students know expectations, they rise to the challenge!

23 Culminating Project Assessment Rubric
Demonstrates understanding of the major ideas, concepts, and skills covered in the targeted learning objectives. Demonstrates ability to apply the knowledge and skills covered in the targeted learning objectives. Demonstrates ability to reflect on the quality of his/her work in relationship to the targeted learning objectives, providing examples of strengths and limitations of work samples and the final product.. Demonstrates contribution in the group through all stages (i.e., work samples and the final product). In most cases the teacher will be doing the final assessment of student performance in the culminating project. Each student will be rated on each of the four dimensions above, and then the teacher will make an overall judgment of whether or not students met expectations. It is the overall judgment that will count as a “pass” for purposes of certification.

24 End-of-Course Exams All EOCs
Assess 16 Critical Learning Objectives Contain 32 Multiple Choice Questions(MCs) MCs in field test Include 4 Constructed Response Questions (CRs) + 1 CR in field test Total 40 Questions The End of Course Exam for every course is constructed in exactly the same way. 16 course learning objectives are selected for assessment using the end of course exam. These 16 must be important, they must be assessable using multiple choice and short answer constructed response item types, and they must be evenly distributed over the units into which the course content has been organized. The selected learning objectives have been vetted by industry representatives for importance relative to subject matter and course content. The individual items have been reviewed by both industry representatives and experienced teachers for appropriateness.

25 End-of-Course Exams Scoring
Multiple Choice Items are scored immediately by the system 1 Pt. per Correct Answer = 32 pts. Field Test Items Not Scored Constructed Response Items must be scored by the teacher Scoring Rubric 2 Pts. Possible Per Answer = 8 pts. The Scoring Rubric for Constructed Response Items is very simple. Each CR item requires two answers, and each answer is worth 1 point.

26 End-of-Course Exams Student EOC Log In Required Log In Info Log in
Click Student access Help Students will need their ID, School Code and the Proctor Password TIP – Write the School code and Proctor Code on the Board Required Log In Info

27 End-of-Course Exams Student EOC View Navigation
Help button will provide reminders about key features during the exam period Review button allows the student to review skipped or marked exam items Marked button allows the student check mark an item for closer review at a later time Strikeout feature allows the student to eliminate rejected answers while reviewing an item.

28 End-of-Course Exams Administrative Guide – Assessed Learning Objective
The sixteen targeted and assessed learning objectives, with their locations in the curriculum, that are assessed with the EOC, are listed in the Admin Guide for Student Certification for each course. Here is a partial listing for Principles of Information Technology. The index number of a learning objective identifies the related Unit and Lesson and is your key to locating course content assessed with the End of Course Exam.

29 Supervisor Assessment of College and Career Readiness (SACCR) =
SCAS Components Supervisor Assessment of College and Career Readiness (SACCR) = Internship Assessment Culminating work-based learning experience and the summative assessment for purposes of NAF certification Kevin SCAS represents a multi-method approach to assessing a broad range of content and skills through rigorous end-of-course exams and culminating project assessments combined with supervisor and teacher feedback. SCAS efficiently supports multiple assessment methodologies by combining multiple-choice and constructed-response assessments with performance-based tasks (e.g., classroom-embedded activities, internships). Specifically, the SCAS consists of the following major components: End-of-Course Assessment – Includes a Culminating Project Assessment for Certification (CPAC) and an End of Course (EOC) exam that assess the scope of knowledge and skills across NAF courses. Supervisor Assessment of College and Career Readiness (SACCR) - An internship is the culminating work-based learning experience and the summative assessment for purposes of NAF certification. At the end of a qualified culminating work-based learning experience, a student’s direct supervisor completes the Internship Assessment.

30 SCAS Components Internship Assessment For Certification
Participate in a 120-hour internship (2015)* Receive a 2, 3, 4 performance level within each dimension; and Meet or exceed expectations on a majority of the dimensions in the four categories; and Be rated as “Meets Expectations/Usually” (3) or “Exceeds Expectations/Always” (4) on a set of dimension deemed “high value:”    Participate in a 120-hour internship. – NOTE this will be a requirement for any internship that is a part of SCAS AFTER May 2015. Receive a 2, 3, 4 performance level within each dimension - This means NO 1s or 0s More than 50% of the items must be 3 or 4s within each dimension which equates to the the entire assessment Foundational Skills Applies Workplace Skills Self-Management Skills Career Contextual Knowledge Skills Position-Specific Technical Skills See next slide

31 SCAS Components Internship Assessment For Certification
High Value Dimensions – Score 3 or 4 Part IA3. Critical Thinking – Foundational Skills Part IB4. Teamwork/Collaboration – Applied Workplace Skills Part IC9. Exhibits responsible and professional behaviors – Self-Management and Personal Responsibility, Part II4. Knows how to interact with supervisors, clients, and teammates – Knowledge of the Field and Organizational Context MUST score a 3 or 4 on these items …. Should let supervisor know this….not to coerce but to inform

32 Foundational Skills Foundational skills assessed in the internship. Note that 3 of the seven skills assessed separately here are often represented together simply as communication skills (listening and observation, oral communication, and written communication). While that makes sense when trying to shorten a list of outcomes for purposes of communication, the input we received from industry representatives in our assessment development process was that these three distinctly different communication skills should be separately addressed in a performance assessment.

33 Applied Workplace Skills
Applied Workplace skills assessed in the internship. Some of the skills grouped here are listed in our CCR definition document as foundational skills, and others form the core of what that document identifies as interpersonal skills. Again, these differences in grouping are largely a result of differences in the purposes of the lists: one to communicate to a broad audience, the other to assess performance in actual work situations.

34 Self-Management Skills
Self-Management assessed in the internship. The list of self-management skills is much more detailed for purposes of assessment than it is in the CCR definition document. Every item in the assessment form is there because an argument was made during assessment development for keeping it separate. We suspect that with analysis of a sufficiently large number of results, we will be able to make an argument based on empirical evidence for reducing the number of items here by consolidating some of the more highly correlated ones.

35 Career Contextual Knowledge
Contextual knowledge of career requirements and the workplace are also assessed in the internship. Part II of the internship assessment includes only four items. The first two could be considered a check on the career content and contextual knowledge that is more specifically and thoroughly assessed through course-based project assessments and end of course exams. The third and fourth are important learnings that can really only be assessed in the context of a real work experience like the internship. In a shorter list, for communication purposes, the fourth item might be considered covered by interpersonal skills as assessed in the applied workplace skills category. But here the focus is on interaction between and within workplace defined roles.

36 Position-Specific Technical Skills
Part III of the internship assessment is important for information gathering that will help NAF and the academies better understand what position-specific skills employers are expecting for program improvement purposes; but by definition, these are skills that are not necessarily needed across all career paths, so they are not counted in the internship assessment for CCR certification purposes.

37 Overview Student Certification Assessment System Participation

38 SCAS Participation Academy Support Hub About SCAS
Section 1 – About NAF SCAS SCAS FAQ – Participation Rollout Overview Rollout Checklist SCAS Task Chart Karlene – Share where to find the information on ASH

39 SCAS Participation SCAS About – Reference Manual

40 Participation Considerations Information Technical Requirements
Rollout Plan Karlene Hand out the Task Chart, Rollout Check List, and Overview

41 District SCAS Administrator Academy SCAS Administrator
Everyone Has Role Roles District SCAS Administrator Academy SCAS Administrator School Technical Support Teacher Karlene Hand out the Task Chart, Rollout Check List, and Overview

42 Timing is Everything Timing Before Course During Course Before Exam
Day of the Exam After Exam Karlene Hand out the Task Chart, Rollout Check List, and Overview

43 Award Process Announcement - January Notification - April
NAF notifies all District SCAS Administrators about requirements, timeline and process for SCAS student eligibility . Notification - April District SCAS Administrator notifies student who are eligible for certification about timeline, application process, and requirements. Identification - May 1st week District SCAS Administrator submits a completed NAF SCAS Eligible Student Form for students completing all SCAS requirements . Application - May 2nd week SCAS eligible students submit to NAF a completed application with permission to review data. Validation - June 1st NAF confirms that students have met SCAS certification standards and releases offical certificate to District SCAS Administrator Award June 15th Upon gradauation, District SCAS Adminsitrator awards SCAS certificate to student and enters data into system. Kevin

44 SCAS ? Just Ask. Kevin – Role Play -----

45 SCAS Resources – Online
SCAS Help SCAS Resources – Online Academy Support Hub - Modules About SCAS Getting Started CPAC EOC IA Kevin –

46 SCAS Help To participate in SCAS or for information about SCAS training, please contact your NAF Network Liaison. For contact information, please click here: http://naf.org/staff. Kevin –

47 SCAS Help While using the system, please review the “Help” section in the navigation list at the left side of your screen.  Tips are provided for you regarding several key activities.  Kevin –

48 SCAS Help For expert technical support, please contact Internet Testing Systems (ITS). The ITS support team is available Monday through Friday from 8 am to 5 pm EST online, via or by phone.  An online request for assistance can be submitted when logged into the system. The ITS support and phone is Kevin –


Download ppt "Student Certification Assessment System (SCAS)"

Similar presentations


Ads by Google