1 Sarah McManus and Hope Tesh-Blum North Carolina Department of Public Instruction Division of Accountability Services/Testing Section North Carolina High School Exit Exam: Overview and Update

2 North Carolina Department of Public Instruction Division of Accountability Services/Testing Section February, 2002/Accountability Conference Competency Tests: History &What will happen? Old Competency Minimum performance levels in areas of Math, Reading, and Writing (prior to ) New Competency Levels of performance in Reading and Math (during or after )

3 North Carolina Department of Public Instruction Division of Accountability Services/Testing Section February, 2002/Accountability Conference GATEWAYS Statewide Student Accountability Standards Grades 3, 5, 8, and 12 New Student Promotion Standards APA Policy 16CAC6D.0305 Approved by SBE 4/1/99

4 North Carolina Department of Public Instruction Division of Accountability Services/Testing Section February, 2002/Accountability Conference Measurement Goals Essential Skills Higher Order Thinking Skills Integration Application Evaluation Big Concepts/Ideas Math Science Social Studies English

5 Gateways * State Board Decision February 2, 2001

6 North Carolina Department of Public Instruction Division of Accountability Services/Testing Section February, 2002/Accountability Conference Six Domains Communication Processing Information Problem Solving Using Numbers and Data Technology Team Work

7 North Carolina Department of Public Instruction Division of Accountability Services/Testing Section February, 2002/Accountability Conference Development of Learning Objectives (for each domain) Division of Instruction Services Division of Accountability Services/Testing Section Research Previous studies of what students should know and be able to do

8 North Carolina Department of Public Instruction Division of Accountability Services/Testing Section February, 2002/Accountability Conference NCHSEE Key Characteristics Active Involvement Scenarios and Situations Real-World Applications Use of Primary Source Materials Variety of Presentations (i.e., not simply reading or math) Integration of Content (i.e., not facts tested in isolation)

9 North Carolina Department of Public Instruction Division of Accountability Services/Testing Section February, 2002/Accountability Conference Who’s on the Development Team?

10 Test Development Team: Riverside Publishing Company Producing items, tests, technical documents, & resource materials Standard setting

11 NCHSEE Committee Approves all of Riverside’s Work Division of Accountability Services Division of Instructional Services Division of Exceptional Children

12 NCHSEE Advisory Board provides feedback and advice to NCHSEE Committee about administrative procedures, etc. NCAE Test Coordinators Principals Central office staff Division of Accountability Services Division of Instructional Services Division of Exceptional Children

13 North Carolina Department of Public Instruction Division of Accountability Services/Testing Section February, 2002/Accountability Conference Technical Advisory Committee Purpose: To provide advice about field test design, standard setting, etc.  UNC-Chapel Hill  University of Michigan  UNC-Greensboro  American Institute of Research

14 North Carolina Department of Public Instruction Division of Accountability Services/Testing Section February, 2002/Accountability Conference Item Development N.C. Educators, Curriculum Specialists and professional item writers NCDPI Instructional Services NCDPI Accountability Services/Testing NCDPI Exceptional Children Riverside Publishing Company

15 North Carolina Department of Public Instruction Division of Accountability Services/Testing Section February, 2002/Accountability Conference November 2001 NC State Board of Education approves several changes to the test format of the Exit Exam Delay in funding and the need to reduce amount of time spent testing

16 North Carolina Department of Public Instruction Division of Accountability Services/Testing Section February, 2002/Accountability Conference Exit Exam Format Revisions Original Format Multiple-Choice Four separate tests items per test Two hours test time per test / 4 days Revised Format Multiple-Choice One test/Four items total (25 per section) Three hours total test time / one day

17 North Carolina Department of Public Instruction Division of Accountability Services/Testing Section February, 2002/Accountability Conference What four sections (domains) are tested?

18 North Carolina Department of Public Instruction Division of Accountability Services/Testing Section February, 2002/Accountability Conference Four Assessed Domains Communication Processing Information Problem Solving Using Numbers and Data

19 North Carolina Department of Public Instruction Division of Accountability Services/Testing Section February, 2002/Accountability Conference Communication Section Two types of items: Embedded Error: Evaluate critically and analyze printed material Scenarios: Understand and apply accurately the rules of Standard English LISTENING ITEM REMOVED

20 North Carolina Department of Public Instruction Division of Accountability Services/Testing Section February, 2002/Accountability Conference Processing Information Section Requires Students to: Process multiple Types of data Interpret, analyze, synthesize Make appropriate inferences, predictions, or plans

21 North Carolina Department of Public Instruction Division of Accountability Services/Testing Section February, 2002/Accountability Conference Problem Solving Section Requires Students to: Analyze and evaluate problems in a variety of scenarios Identify potential solutions or choices

22 North Carolina Department of Public Instruction Division of Accountability Services/Testing Section February, 2002/Accountability Conference Using Numbers and Data Section Requires Students to: Apply mathematical and data analysis skills and concepts to solve problems in a variety of contexts

23 North Carolina Department of Public Instruction Division of Accountability Services/Testing Section February, 2002/Accountability Conference Timeline (as of February 18, 2002) : Item Tryout (all 11th graders) : Field Test 11th graders) : Field Test (*All 11th graders) : Operational (*All 11th graders) : *Graduation Requirement for Class of 2005 * 11th grade students following the C/U Prep, C/T Prep, or Career Prep Courses of Study.

24 North Carolina Department of Public Instruction Division of Accountability Services/Testing Section February, 2002/Accountability Conference Samples for Testing (as of February 18, 2002) 2001 Item Tryout Every High School All 11 th grade 64,000 students Accommodations Scored by contractor 2 hours per test 2002 Field Test Sample of High Schools All 11 th grade students in a selected high students Accommodations Scored by contractor 180 min. total test adm. time

25 All students should be given sufficient time to complete the tests. NOTE: A few minutes of additional time will be needed at the end of the testing period to check answer sheets, complete coding, and collect test materials. Estimated Test Administration Time

26 North Carolina Department of Public Instruction Division of Accountability Services/Testing Section February, 2002/Accountability Conference Other Test Materials Calculator Use: ›Graphing Calculator is required for the entire test Blank Paper X No Graph paper

27 North Carolina Department of Public Instruction Division of Accountability Services/Testing Section February, 2002/Accountability Conference Real Deal: Class of 2005 and Beyond Administered to all 11 th grade students in Spring of 2004 Class of 2005 must pass this test to receive a diploma Retesting opportunities available

28 Re-testing Opportunities Summer School (Junior year) Fall (Senior year) Spring (Senior year) Last month (Senior year) Age 21

29 Students Following C/U Prep., C/T Prep., or Career Prep. Courses of Study:To Receive a Diploma (Class of 2005 and beyond) Local Requirements Existing State Requirements Passing score on exit exam (class of 2005) Passing score on computer skills tests

30 North Carolina Department of Public Instruction Division of Accountability Services/Testing Section February, 2002/Accountability Conference Resource Materials Information Guide/Brochure (February 2002) Student Handbook (February 2002) NCDPI Websites (Testing and Instructional Services)

31 Testing Website: accountability/testing/ highschoolexitexam/

32 Instructional Services Website: learnnc.org/dpi/instserv.nsf/Category11/

33 Questions?