1. Nevada Department of Education Office of Educational Opportunity Nevada Comprehensive Curriculum Audit Tool for Schools NCCAT-S August 2013 1

2. Nevada Comprehensive Curriculum Audit Tool for Schools Purpose of Presentation Provide information on the NCCAT-S Process Review NCCAT-S requirements for Schools set forth in the ESEA Flexibility Waiver for the 2013-14 School Year 2

3. What is the NCCAT-S? The Nevada Comprehensive Curriculum Audit Tool for Schools (NCCAT-S): Identifies a school’s strengths and needs in the areas of Curriculum & Instruction, Assessment & Accountability, and Leadership Provides critical data for the development of the School Performance Plan August 2013 3

4. Who can utilize the NCCAT-S? The NCCAT-S is a recommended process for all schools interested in improving school systems that support and elevate student achievement. 4

5. Who must utilize NCCAT-S Under the NDE Flexibility Waiver, schools classified as 1, 2, or 3-Star Schools must engage in the statewide School Achievement Gap Elimination (SAGE) process which includes the NCCAT-S. School districts will have the authority to determine which of its 3-Star schools will need to conduct the NCCAT-S. 5

6. NCCAT-S Research-Based Foundation NCCAT-S is built from research on school improvement and can serve as the foundation for school improvement. The NCCAT-S has proven beneficial in schools’ and districts’ efforts to identify schools’ successes and needs. NCCAT-S and supplementary support documents provide a foundation for identifying root cause analysis and generate useful information for improvement planning and implementation. 6

7. NCCAT-S Categories NCCAT-S describes characteristics of high- performing schools in the following 3 categories: Curriculum and Instruction Assessment and Accountability Leadership August 2013 7

8. NCCAT-S Indicators 20 Indicators Within each category are indicators that characterize the essential components. 9 Indicators under Curriculum & Instruction 4 Indicators under Assessment & Accountability 7 Indicators under Leadership 8

9. NCCAT-S Elements 70 Elements Provide descriptors that detail an indicator 2 to 5 elements per Indicator The degree to which an element is implemented will be scored on a rubric using the following scale: 4=Exemplary 3=Meets Expectation 2=Area of concern 1=Area of Need 9

10. Activity Exploring the NCCAT-S Rubric Small Group Each person identifies an indicator, along with its elements, that he/she believes is critical to a school’s success. In your group, discuss each indicator that was selected. In your discussion, provide reasons as to why you think your selected indicator is critical. 10

11. NCCAT-S Team Members Districts, in collaboration with the school, form an audit team to help manage and coordinate the NCCAT-S audit process. Suggested team members: School Improvement or Leadership Team, teachers, other school staff, district level personnel and outside specialists, etc. August 2013 11

12. NCCAT-S Pacing Calendar Districts have an entire school year to conduct the NCCAT-S process with schools identified as 1, 2 or 3 star schools. In a traditional school year, initial steps could begin in September Completion of the audit occurs by December Planning finished by June Summary Report submitted to the District by July 1 st August 2013 12

13. NCCAT-S Pacing Calendar September – December Collect NCCAT-S evidence (documents, artifacts, focus groups, interviews) Analyze NCCAT-S evidence and ratings are assigned by NCCAT-S Team Complete NCCAT-S audit August 2013 13

14. NCCAT-S Pacing Calendar January – June NCCAT-S results incorporated and addressed in the School Performance Plan NCCAT-S Summary Report for 1, 2, and 3 star schools submitted to Districts by July 1 st August 2013 14

15. NCCAT-S: How to Begin Break down the work into metered, manageable steps For example, the first audit team meeting in September could encompass the first five indicators (i.e., Curriculum and Instruction, Indicators 1.1 – 1.5) Remaining categories could be addressed in subsequent months 15

16. Tools to Assist Audit Teams Data collection tools have been developed that: Assist teams in managing the collection of evidence Provide suggestions regarding what types of evidence might best support the indicator/element 16

17. Tools to Assist Audit Teams The tools include: Protocols for interviews and focus groups List of documents or sources to review and analyze NCCAT-S Indicator Worksheets to assist teams in recording their findings relative to an indicator 17

18. Activity Using the NCCAT-S Tools Small Group Select an Indicator in the NCCAT-S Choose an Element within that Indicator Review the evidence suggested in the Evidence Guide to support that Element Discuss if there are additional lines of evidence that could be considered for that particular indicator and its elements. 18

19. Collecting & Analyzing the Evidence It is recommended that at least 3 forms of evidence be analyzed in order to inform the scoring of an element It is possible that the same evidence may be appropriate for use in supporting the scoring for multiple elements 19

20. Rubric Scoring Each element must receive a rubric score based on the supporting evidence: 4 (Exemplary) to 1 (Area of Need) Accuracy of the element rubric score is essential because they provide critical information of root causes – For example, if a score is low (1 or 2), it will eventually need to be addressed by the school. 20

21. Prioritization Scoring It may happen that a school has several elements accurately scored on the rubric at 1 (Area of Need) or 2 (Area of Concern) There is a process in place that assists audit teams in determining priorities School Indicator Worksheets will guide a team through assigning a priority and opportunity score, which creates an index score 21

22. Priority Scoring For each element, the Priority Score represents what the audit team considers to be of either highest, medium, or lowest priority for the school to address. Priority Score: 3 = highest priority for school/district to address 2 = medium priority for school/district to address 1 = lowest priority for school/district to address 22

23. Opportunity Scoring The Opportunity Score represents the level of ease or difficulty that the audit team believes the school will face in addressing the element. Opportunity Score: 3 = relatively easy to address 2 = accomplished within current policy and budget conditions 1 = requires changes in current policy and budget conditions 23

24. Index Scoring Multiplying the priority score by the opportunity score, the audit team will create an Index Score Priority Score x Opportunity Score = Index Score Index Scores: Highest Index Score possible: 9 Medium High Index Score: 6 Medium Low to Low Index Scores: 4, 3, & 2 Lowest Index Score possible: 1 24

25. Index Scoring A high Index score of either 6 or 9 will identify those elements that should be addressed by schools and districts and become the foci of the School Performance Plan A low Index score, such as 1 or 2, would indicate that those elements may not need to be addressed, but rather be considered at some point, if appropriate, in the School Performance Plan 25

26. Rubric & Index Scores There are 2 types of scoring that will need to be completed per element: Rubric & Index Be aware of the differences in the scoring scales – they are essentially opposite: – A low Rubric score (1 or 2) coupled with a high Index score (6 or 9) would typically indicate a need to address that particular element 26

27. Activity Exploring Rubric & Index Scoring Examine the Rubric and Index Scoring of the NCCAT-S Refer to the NCCAT-S Worksheets and sample Summary Reports for discussion in your small group Do you have any questions regarding either scoring process? In a large group, share any comments or questions your small group had regarding the NCCAT-S scoring 27

28. Most Valuable Part of the Process Schools have found that the most valuable aspect of NCCAT-S is the rich conversations among team members and staff analyzing the element rubric scores and supporting evidence. 28

29. Final Steps Summary Report The NCCAT-S Summary Report requests a Rubric and Index score per element, as well as evidence to support the Rubric Ratings, that are considered to be of highest priority to be addressed based on the Index and Rubric scores. The Summary Report is due July 1 st to the district 29

30. Website for all NCCAT-S Materials http://www.doe.nv.gov  Resources  Programs  School Improvement Resources  NCCAT-S Resources http://www.doe.nv.gov/Office_Ed_Opportunity/ School_Improvement/NCCATS_Resources/ 30

31. NCCAT-S Materials located on website User Guide Rubric Indicators FAQs Data Collection Tools such as:  Indicator worksheet  Evidence guide  Summary report Template 31

32. Contact Information Homa Anooshehpoor, Office of Educational Opportunity 775-687-9164 homa@doe.nv.gov Gayle Magee, Office of Educational Opportunity 775-687-9215 gmagee@doe.nv.gov August 2013 32