APAC Meeting | January 22, 2014 Texas Education Agency | Office of Assessment and Accountability Division of Performance Reporting Overview of Performance Indexes Used for State Accountability

Accountability System Design

Accountability Goals 3 Texas will be among the top 10 states in postsecondary readiness by 2020, by:  Improving student achievement at all levels in the core subjects of the state curriculum.*  Ensuring the progress of all students toward achieving Advanced Academic Performance.*  Closing Advanced Academic Performance level gaps among groups.*  Rewarding excellence based on other indicators in addition to state assessment results. * These goals are specified in Chapter (f) of the Texas Education Code.

Accountability Framework 4 Factors Considered in Selecting the Performance Index Framework:  Accountability System Goals and Guiding Principles  Statutory Requirements of House Bill 3 (2009):  Focus on Postsecondary Readiness  Inclusion of Student Progress  Emphasis on Closing Achievement Gaps  STAAR program with EOC-based tests for middle schools and high schools  Lessons learned from previous Texas public schools’ accountability rating systems (1994–2002 and 2004–2011)  Successful models used by other states (CA, CO, FL, GA, KY, OH, NC, and SC)

Performance Index Framework 5 What is a Performance Index?  Each measure of student performance contributes points to an index score.  Districts and campuses are required to meet one accountability target for each index— the total index score.  A Performance Index provides a rating that reflects the overall performance of the campus or district rather than the weakest performance of one student group/subject area.  Multiple indexes can be used in the framework to ensure accountability for every student.  Any number of indicators and student groups can be added to the system without creating additional targets for campuses and districts to meet.

Performance Index Framework 6 For 2013 and beyond, an accountability framework of four Performance Indexes includes a broad set of measures that provide a comprehensive evaluation of the campus or district. Accountability System Student Achievement Index I Student Progress Index 2 Closing Performance Gaps Index 3 Postsecondary Readiness Index 4 Student Achievement Index I Student Progress Index 2 Closing Performance Gaps Index 3 Postsecondary Readiness Index 4

Index 1: Student Achievement 7 Index 1: Student Achievement provides an overview of student performance based on satisfactory student achievement across all subjects for all students.  Combined over All Subjects: Reading, Mathematics, Writing, Science, and Social Studies.  Student Groups: All Students.  Performance Standards: Phase-in 1 Level II (Satisfactory).

8 Index 1: Student Achievement Example: 2013 Index 1 ReadingMathematicsWritingScience Social Studies Total % Met Phase-in 1 Level II Index Points Students Met or Exceeded Phase-in 1 Level II =136 45%45 Students Tested =305 Index 1 Score45 Index 1: Construction Since Index 1 has only one indicator, the Total Index Points and Index Score are the same: Index Score = Total Index Points. Total Index Points is the percentage of assessments that meet the Phase-in 1 Level II Standard. Each percent of students meeting the Phase-in 1 Level II performance standard contributes one point to the index. Index scores range from 0 to 100 for all campuses and districts.

9 Index 2: Student Progress focuses on actual student growth independent of overall achievement levels for each race/ethnicity student group, students with disabilities, and English language learners.  By Subject Area: Reading, Mathematics, and Writing (for available grades).  Points based on weighted performance:  One point given for each percentage of tests at the Met progress level.  Two points given for each percentage of tests at the Exceeded progress level. Index 2: Student Progress

STAAR Weighted Progress Rate All Students African Amer. Amer. Indian AsianHispanic Pacific Islander White Two or More Races ELL Special Ed. Total Points Max. Points Example Calculation for Reading Progress Number of Tests Performance Results: Met or Exceeded Progress Number Percent 80 80% 40 80% % 20 67% Exceeded Progress Number Percent 20 20% 20 40% 30 75% 5 17% Reading Weighted Progress Rate Index 2: Construction – Table 1 Index 2: Student Progress

STAAR Weighted Progress Rate All Students African Amer. Amer. Indian AsianHispanic Pacific Islander White Two or More Races ELL Special Ed. Total Points Max. Points Reading Weighted Progress Mathematics Weighted Progress Writing Weighted Progress Total Index 2 Score (total points divided by maximum points)64 11 Index 2: Construction – Table 2 Index 2: Student Progress

12  Points based on weighted performance:  Phase-in 1 Level II satisfactory performance (2013 and beyond): One point for each percent of tests meeting the Phase-in 1 Level II satisfactory performance standard.  Level III advanced performance (2014 and beyond): Two points for each percent of tests meeting the Level III advanced performance standard.  The calculation of the STAAR weighted performance rate was modified in 2013 because statute prohibited the inclusion of STAAR Level III advanced performance until Index 3: Closing Performance Gaps Index 3: Closing Performance Gaps emphasizes advanced academic achievement of economically disadvantaged students and the two lowest performing race/ethnicity student groups.

Index 3: Closing Performance Gaps 13  By Subject Area: Reading, Mathematics, Writing, Science, and Social Studies.  Student Groups:  Economically Disadvantaged  Lowest Performing Race/Ethnicity: The two lowest performing race/ ethnicity student groups on the campus or within the district (based on prior-year assessment results).

14 Index 3: Closing Performance Gaps 14 Index 3: Construction – Table 1 STAAR Weighted Performance Rate Economically Disadvantaged Lowest Performing Race/Ethnic Group - 1 Lowest Performing Race/Ethnic Group - 2 Total Points Maximum Points Example Calculation for Reading Weighted Performance Number of Tests Performance Results: Phase-in 1 Level II Satisfactory and above Number Percent % 20 50% % Level III Advanced Number Percent 40 50% 0 0% % Reading Weighted Performance Rate

STAAR Weighted Performance Rate Economically Disadvantaged Lowest Performing Race/Ethnic Group - 1 Lowest Performing Race/Ethnic Group - 2 Total Points Maximum Points Reading Weighted Performance Mathematics Weighted Performance Writing Weighted Performance Science Weighted Performance Social Studies Weighted Performance Total Index 3 Score (total points divided by maximum points)48 15 Index 3: Construction – Table 2 Index 3: Closing Performance Gaps

Index 4: Postsecondary Readiness 16 Index 4: Postsecondary Readiness emphasizes the importance of earning a high school diploma that provides students with the foundation necessary for success in college, the workforce, job training programs, or the military; and the role of elementary and middle schools in preparing students for high school. STAAR Percent Met Final Level II on One or More Tests  2014 and beyond (college-readiness performance standards were not included in accountability in 2013).  Combined over All Subjects: Reading, Writing, Mathematics, Science, and Social Studies.

17 Index 4: Construction  Graduation Score: Combined performance across the graduation and dropout rates for  Grade 9-12 Four-Year Graduation Rate for All Students and all student groups; OR  Grade 9-12 Five-Year Graduation Rate for All Students and all student groups, whichever contributes the higher number of points to the index.  RHSP/DAP Graduates: All Students and race/ethnicity student groups.  STAAR Score: STAAR Percent Met Final Level II on one or more tests for All Students and race/ethnicity student groups (2014 and beyond).  For high schools that do not have a graduation rate: The annual dropout rate and STAAR Final Level II performance contribute points to the index. For elementary and middle schools, only STAAR Final Level II performance contributes points to the index. Index 4: Postsecondary Readiness

18 Index 4: Postsecondary Readiness Indicator All Students African Amer. Amer. Indian AsianHispanic Pacific Islander White Two or More Races ELL Special Ed. Total Points Max. Points 4-year graduation rate (Gr 9-12) 84.3%78.8% 91.6%86.0%44.2%69.8% year graduation rate (Gr 9-12) 85.1%78.8%80.0%92.1%84.0%48.9%77.5% RHSP/DAP82.7%76.4%83.6%83.0% Graduation Total Graduation Score (graduation total points divided by maximum points) and beyond: STAAR % Met Final Level II on one or More Tests 29%16%40%23%38%36% STAAR Score (STAAR total points divided by maximum points)30 Index 4 Score (average of Graduation Score and STAAR Score: / 2 = 55)55 Index 4: Construction

System Safeguards 19 Safeguard Measures and Targets:  Reporting system disaggregates performance by student group, performance level, subject area, and grade.  Performance rates are calculated from the assessment results used to calculate Index 1: Student Achievement.  Targets for the disaggregated system-safeguard results:  STAAR performance target corresponds to Index 1 (50%);  STAAR participation target required by federal accountability (95%);  Federal graduation rate targets and improvement calculations for 4-year rate (78%) and 5-year rate (83%); and  Federal limit on use of alternate assessments (1% and 2%).

Accountability System Safeguard Measures and Targets System Safeguards * Targets for 2013 correspond to the performance target for Index 1: Student Achievement. Indicator All Students African Amer. Amer. Indian AsianHispanic Pacific Islander White Two or More Races Eco. Disadv. ELL Special Ed. Performance Rates* Reading50% Mathematics50% Writing50% Science50% Social Studies50% Participation Rates Reading95% Mathematics95% Federal Graduation Rates (including improvement targets) 4-year78% 5-year83% District Limits on Use of Alternative Assessment Results Reading Modified2%Not Applicable Alternate1%Not Applicable Mathematics Modified2%Not Applicable Alternate1%Not Applicable

System Safeguards 21  Results will be reported for any group that meets accountability minimum size criteria.  Failure to meet the safeguard target for any reported group must be addressed in the campus or district improvement plan.  Performance on the safeguard measures will be incorporated into the Texas Accountability Intervention System (TAIS).  Detailed information is available in the Performance Index Technical Description at

Resources  2013 Accountability Rating System  Performance Reporting Home Page  Performance Reporting  Division of Performance Reporting Telephone (512)