1. NC State University Center for Urban Affairs and Community Services

2. What is ClassScape ™ ? Similar to other university-supported initiatives that support educators Online formative assessment system Allows teachers to build classroom tests with system tools Allows teachers to monitor student performance on the Standard Course of Study academic indicators Facilitates learning by focusing on curricular objectives Collaborative effort NC State University Center for Urban Affairs and Community Services North Carolina Department of Public Instruction— Accountability Division

3. O bjectives To help teachers Focus instruction with Standard Course of Study academic indicators Identify class strengths and weaknesses Identify individual student strengths and weaknesses

4. Objectives, cont’d To assist teachers in Achieving curriculum/instructional alignment Maintaining curriculum/instructional alignment by providing assessment items approved by content experts and based on all curricular objectives

5. Objectives, cont’d To allow teachers To self-assess instructional strategies To monitor student progress on an ongoing basis To select objectives to assess throughout the school year To access real-time feedback reports

6. Schedule Grade Three Grade Four Grade Five Grade Six Grade Seven Grade Eight 2005-06 Math (Pilot) Math (Pilot) 2006-07 Math 2007-08 Math Reading Math Reading Math Reading 2008-09 Math Reading Math Reading Math Reading Math Reading Math Reading Math Reading 2009-10 Math Reading Math Reading Math Reading Science Math Reading Math Reading Math Reading Science

7. First-Year Development Establish and register name and logo Construct and register website Build item database Assemble focus group of teachers, curriculum specialists, and instructional administrators Design online item writing and reviewing system Design online test delivery system Beta test system with volunteers

8. Second-Year Development Evaluate online test delivery system Refine test delivery system Identify and visit pilot schools Test online system with pilot schools Develop training tools and tech support

9. Annual Development Determine weight of curricular objectives Populate database with existing items Reclassify and review existing items Identify gaps and contract items where necessary Review and revise items Refine online testing system Recruit school participants

10. Why Grades 5 & 8 Math? Why math first? Time crunch for 2005-2006 pilot Fewer copyright issues Pilot to coincide with new curricula Why grades 5 & 8 first? Benchmark grades Grade 8 current competency grade

11. Item Collection “Secure for Local Use” items Revised items not used in testing system Items reviewed by off-duty North Carolina teachers (w/stipend) New items by vendor contracts

12. Online Testing System Acceptable Use policy Teachers assemble small or medium assessments on one or more objectives Students can attempt to demonstrate mastery of objective up to three times Large item pool to avoid overexposure Requesting demographic information to ensure quality as part of research and development

13. Student View Anticipated tools and other features Clock Formulas provided within question stem Full screen—web options disabled Ability to jump forward/backward during testing Accommodations Project Development Team visited Governor Morehead School and Assistive Technology Center Items reviewed for EC/ESL considerations Tests and items use Universal Design

14. Teacher View Pulling up assessment items By goal (20-30 items) By objective (10-20 items) By keyword (10 items) Reporting format Item Objective Thinking skill Difficulty level Accuracy of response Classroom percentage Overall population’s percentage

15. Sample Teacher Feedback Report Answers By Student for Objective 1.01a 12345678910Percent  Total  Total  Total – Brendan  –  80%811 Brian–  70%721 Dan  –  80%811 Davida  90%910 Elizabeth  80%820 Faye  –  –  50%532 Jeff  80%820 Jennifer  –  80%811 Jerrie  –  80%811 Phyllis  –  80%811 Qing–  –  ––30%334 Sean  –  –  80%802 Shakir  90%910 Shirley  90%910 Sloane  90%910 Susie  –  90%901 Tiha  100%1000 Test Total  17 1816617 18 Test Total  1213922211 Test Total –2111511111 Class  85% 90%80%30%85% 90% District  87%83%94%70%50%88%35%92%82%83% ClassScape  82%80%87%67%48%81%42%84%78%85%

16. Sample Teacher Feedback Report

17. ClassScape Percent Correct for Obj 1.01a

18. Sample Teacher Feedback Report Percent Correct By Student for All Goals (Last Administration Taken by Student) Goal 1Goal 2Goal 3Goal 4Goal 5 AverageMaxMin Brendan80%70%80% 90%80%90%70% Brian90% 100%80%90% 100%80% Dan80% 70%90%100%84%100%70% Davida90%100% 90%96%100%90% Elizabeth80% 90% 80%84%90%80% Faye100%80% 90% 88%100%80% Jeff80% 100% 88%100%80% Jennifer80%100% 90%94%100%80% Jerrie80%90% 80%90%86%90%80% Phyllis80%70%90% 84%90%70% Qing80%70% 80%90%78%90%70% Sean80% 90% 84%90%80% Shakir90%80%100% 90%92%100%80% Shirley90% 80%90% 88%90%80% Sloane90%80%90%100%90% 100%80% Susie90% 100% 90%94%100%90% Tiha100%90%100% 90%96%100%90% Average 87%84%90%93%92% Average 89% Goal Max 100% Goal Min 70% ClassScape Average73%80%87%90%48%

19. Sample Teacher Feedback Report

20. Website Site map Purpose and objectives Portal to item writing, item reviewing, and testing system Screen shots of student view and teacher view Calendar of events Online form to request participating in future review sessions FAQs, contact info, and tech support Enter by state Flash video Statements by previous users

21. Pilot School Recommendations? Need to select pilot schools for Grades 5 and 8 math for 2005-2006 Program free of charge for pilot schools Seeking 10-15 pilot schools throughout state Need 6 elementary and 4 middle school recommendations per region Schools should challenge system with all ranges of technical capacity, but minimum capacity must meet NCCATS requirements Schools must be willing to work with us on technical issues.

22. Additional Information Sloane Thrasher sloane_thrasher@ncsu.edu (919) 515-1301 Phyllis Jernigan phyllis_jernigan@ncsu.edu (919) 515-1301 Website: http://classscape.ncsu.eduhttp://classscape.ncsu.edu