2014 Accountability System 2014 Accountability System Overview Kim Gilson Senior Consultant Data and Accountability

Accountability Resources:

Accountability Resources FAQ:

2014 Ratings Labels

Performance Index Framework Index 1Index 2Index 3Index 4 Student Achievement Student ProgressClosing Performance Gaps Postsecondary Readiness Rating based on 4 Performance Indexes All Targets Must Be Met

In a nutshell…  Formerly excluded ELLs come into the system  Progress available to more students in index two  Held to Level III advanced in Index Three  Held to Final Recommended in Index Four  Safeguard Targets Increase  More Distinctions Available  First Year of No High School TAKS Scores

LOOKING FORWARD… 2014 to 2015…

STAAR Phase-In Changes Announced

STAAR Standards Phase-In Old to New 10 Advanced Level III: No Changes

New Math TEKS and Accountability Students who participate in the spring 2015 STAAR grades 3–8 mathematics administrations will receive a raw score prior to the end of the school year. Once new performance standards are approved, they will be retroactively applied to students’ test results from the spring 2015 administrations. New reports and data files will be sent to school districts in August 2015.

New Math TEKS and Accountability Student Success Initiative (SSI) retest opportunities for STAAR mathematics at grades 5 and 8 will not be offered in For the 2014–2015 school year, districts will use other relevant academic information to make promotion/retention decisions for mathematics. Please note that SSI will still be in effect for reading in 2014–2015.

New Math TEKS and Accountability 2015 state and federal accountability results will not be based on the new standards. For accountability purposes only, the state plans to establish a link between the spring 2015 STAAR grades 3–8 mathematics tests and the previous mathematics tests to determine equivalent performance standards

STAAR A  STAAR M is no longer available  STAAR A is an online version of Regular STAAR with digitally based accommodations  Available to Special Education students and 504 students with dyslexia or a related disorder  STAAR A is NOT subject to the 2% cap on alternative assignments

STAAR Alternate 2  Paper/pencil version of STAAR Alt  Standardized  Still subject to 1% cap on Alternative Assessments

Index 1 Did Students Meet Level II Phase-In I?

Index 1: Student Achievement Index 1: Student Achievement provides an overview of student performance based on satisfactory student achievement across all subjects for all students  Combined over All Subjects: Reading, Mathematics, Writing, Science, and Social Studies.  Student Groups: All Students.  Performance Standards: Phase-in 1 Level II (Satisfactory).  STAAR End-of-Course (EOC) Assessments (15 total):  Reading I; Reading II; Reading III  Writing I; Writing II; Writing III  Algebra l; Geometry; Algebra ll  Biology; Chemistry; Physics  World Geography; World History; US History  English Language Learners (English and Spanish tests):  ELLs in US schools Years 1-3 excluded  ELLs in US schools Year 4 or more included 2014  Combined over All Subjects: Reading, Mathematics, Writing, Science, and Social Studies.  Student Groups: All Students.  Performance Standards: Phase-in 1 Level II (Satisfactory).  STAAR End-of-Course (EOC) Assessments (5 total):  English l; English ll  Algebra l  Biology  US History  English Language Learners (English and Spanish tests):  ELLs in US schools Year 1 excluded  ELLs in US schools Year 2 and beyond included

EOC’s and Accountability: TEA takes the BEST SCORE of a the PREVIOUS July, December, and Current May Administration (regardless of when student first tested)

How Many Students Passed (Phase-in 1 Level II) How Many Students Took The Test NEW TARGET FOR 2014 is 55% (2013 was 50%) Index 1: Student Achievement

Index 1 Target: 55 (AEC’s: 30) Group: All Students Index 1 Data Table Study

Looking to 2015…  Expect an increase in the target  2013 was 50  2014 was 55  Statutory Requirements are that all assessments are included in the accountability system.  Index 1 “works” for all tests, including new ones!

Index 2 Student Growth (Not evaluated for AEC’s or High Schools)

Big Idea: Did ALL Students Improve from their 2013 Performance?

ALL Students…  Low students  Middle students  Special Education students  High Performing students  Students of all Race/Ethnicities

Index 2: Student Progress focuses on actual student growth independent of overall achievement levels for each race/ethnicity student group, students with disabilities, and English language learners.  New for 2014:  Students who skip grades included  Students who transition from Spanish to English in mathematics included  3 rd grade student who receive ELL progress measure will count  ELL Denials: Students whose parent(s) have denied ELL services included  Considered as Non-ELL student for Index 2 Index 2: Student Progress

Surprise!  ELL students in 3 rd Grade received an ELL Progress Measure

Index 2: Student Progress  Progress Measures by Subject Area and School Type 2013 Elem. SchoolMiddle SchoolHigh School READING Gr. 4 ReadingGr. 6 ReadingEnglish l Reading Gr. 5 ReadingGr. 7 ReadingEnglish ll Reading _Gr. 8 Reading_ _English l Reading _ MATHEMATI CS Gr. 4 Mathematics Gr. 6 Mathematics Algebra l Gr. 5 Mathematics Gr. 7 Mathematics _ _Gr. 8 Mathematics _ _Algebra l_ WRITING __English ll Writing 2014 Elem. SchoolMiddle SchoolHigh School READING Gr. 4 ReadingGr. 6 Reading_ Gr. 5 ReadingGr. 7 Reading_ _Gr. 8 Reading_ ___ MATHEMATIC S Gr. 4 Mathematics Gr. 6 Mathematics Algebra l Gr. 5 Mathematics Gr. 7 Mathematics _ _Gr. 8 Mathematics _ _Algebra l_ WRITING ___

High Schools and Index 2  You didn’t receive a rating, BUT you have data, AND contributed to the district  Algebra 1: A Full Class!  Reading: ELL Progress Measure and STAAR Alt  Last Page of Distinction Designations will give you a Quartile Ranking for Math and Reading “Greater Than Expected Student Growth”

Quartile Data  Last Page of Distinction Designation Report

Weighted Index: 1 Point for Meeting Growth 2 Points for Exceeding Growth Minimum Size: 25

Index 2: Student Progress 2014: Reading and Math Are The Only Subjects Included The index calculation is a 2-step process

Index 2: Student Progress Index 2: 2014 Construction – Page 21 Acct. Manual

Index 2: Student Progress

Index 2 Target: Targets (released July 29): District 16 Elementary 33 Middle 28 High School/K-12 NA Groups: Race/Ethnicity, Sped, ELL Minimum Size: 25 Index 2 Data Table Study

Index 2  - This index does not discriminate  Of those campuses who missed Index 2:  10 <55 (missed Index 1)  in Index 1  in Index 1  in Index 1  2 90’s (92 and 95) in Index 1

Looking Forward…  2015: 7 th Grade Writing!!!  3-8 Math will not receive a Growth Measure for 2015  This leaves: Reading, Writing, and Math for ELL students  Index 2 is “TBD” for grades 3-8 for 2015  Students who change test formats (M to Regular, or Anyone taking A) will not receive a growth measure  HIGH SCHOOL IS BACK IN INDEX 2!!!

Looking Forward  High School Index 2 Will be Comprised of:  Eng 1 to Eng 2  8 th Grade Math to Algebra 1  So…No Eng 1…..except for ELL’s through the ELL Progress Measure

Looking Forward…  What if my campus is Improvement Required for Index 2….and then we don’t receive an Index 2 score in 2015???

Index 3: Closing Performance Gaps

Big Idea: “Passing” Isn’t Enough! Performance at the Highest Level is Achieved for ALL Students

Let’s Put it in Instructional Language:  Who is answering the 5-6 hardest questions on the test correctly?  Note that before they can answer them correctly…  They must have prior experience in problems of that rigor AND  They must be expected to attempt them independently

Groups: Econ Dis AND Lowest Performing Student Groups from Last Year

Group Selection From 2013 Data, any race/ethnicity group with at least 25 tests in Reading AND Math is eligible. The lowest performing are chosen for 2014 analysis If 3+ groups meet minimum size, then lowest 2 are chosen If 2 groups meet minimum size, then lowest is chosen If 1 group meets minimum size, then no race/ethnicity group is used

2013  Points based on STAAR performance:  Phase-in 1 Level II satisfactory performance: One point for each percent of tests MET Phase-in 1 Level II  By Subject Area: Reading, Mathematics, Writing, Science, and Social Studies.  Student Groups:  Economically Disadvantaged  Lowest Performing Race/Ethnicity from 2012 Index 3: Closing Performance Gaps Index 3: Closing Performance Gaps emphasizes advanced academic achievement of economically disadvantaged students and the two lowest performing race/ethnicity student groups  Points based on STAAR performance:  Phase-in 1 Level II satisfactory performance: One point for each percent of tests MET Phase-in 1 Level II  Level III advanced performance: Two points for each percent of tests at the Level III advanced performance standard.  By Subject Area: Reading, Mathematics, Writing, Science, and Social Studies.  Student Groups:  Economically Disadvantaged  Lowest Performing Race/Ethnicity from 2013 data…groups must have 25 tests in reading AND math  Inclusion of ELL Students

Writing, Science, And Social Studies  It is not uncommon to see 0’s for student groups in these subjects  Groups can only be included if they meet minimum size in Reading AND Math  Because Writing, Science, and Social Studies aren’t tested every year, student groups often do not meet minimum size and are excluded from these subjects

Index 3: Closing Performance Gaps Index 3: 2014 Construction – Page STAAR Weighted Performance Rate Economically Disadvantaged Lowest Performing Race/Ethnic Group - 1 Lowest Performing Race/Ethnic Group - 2 Total Points Maximum Points Example Calculation for Reading Weighted Performance Number of Tests Performance Results: Phase-in 1 Level II Satisfactory and above Number Percent % 20 50% % Level III Advanced Number Percent 40 50% 0 0% % Reading Weighted Performance Rate READING

STAAR Weighted Performance Rate Economically Disadvantaged Lowest Performing Race/Ethnic Group - 1 Lowest Performing Race/Ethnic Group - 2 Total Points Maximum Points Reading Weighted Performance Mathematics Weighted Performance Writing Weighted Performance Science Weighted Performance Social Studies Weighted Performance Total Index 3 Score (total points divided by maximum points)48 Index 3: 2014 Construction – Table 2 (based on 2014 assessment results by subject area) Index 3: Closing Performance Gaps

What the reports don’t say…  How do ALL Students compare in Advanced Level III to the Student Groups?  Do we have a problem for ALL Students, or just certain groups?  You need to go back to Pearson reports from last year or use data management programs to find that

Index 3 Data Tables Study Targets (released July 29): Districts 28 Elementary 28 Middle 27 High School/K AEC’s: 11

Looking Forward…  STAAR A is TBD in Index 3

Index 4 Post Secondary Readiness

Index 4: Postsecondary Readiness 2013  Graduation Score: Combined performance across the graduation and dropout rates for:  Grade 9-12 Four-Year Graduation Rate for All Students and all student groups; or  Grade 9-12 Five-Year Graduation Rate for All Students and all student groups, whichever contributes the higher number of points to the index.  RHSP/DAP Graduates: All Students and race/ethnicity student groups. Index 4: Postsecondary Readiness emphasizes the importance of earning a high school diploma that provides students with the foundation necessary for success in college, the workforce, job training programs, or the military; and the role of elementary and middle schools in preparing students for high school  Graduation Score: Combined performance across the graduation and dropout rates):  Grade 9-12 Four-Year Graduation Rate for All Students and all student groups; or (2013 Cohort)  Grade 9-12 Five-Year Graduation Rate for All Students and all student groups, whichever contributes the higher number of points to the index. (2012 Cohort)  RHSP/DAP Graduates: All Students and race/ethnicity student groups. (Class of 2013)  STAAR Score: STAAR Percent Met Final Level ll for All Students and race/ethnicity student groups. Additional Indicators Required by House Bill 5 (83rd Texas Legislature, 2013)  College Ready Graduates. (Class of 2013)

Index 4: 4 Components STAAR Final Level II in 2+ Subjects: ALL Grade Levels Graduation Rate: High Schools Only Recommended/Distinguished Graduates: High Schools Only College Ready Graduates: High Schools Only

STAAR Component This applies to Everyone! Final Level II on 2+ Tests (1 test if a student only takes 1) STAAR and STAAR Modified (No STAAR Alt) All Subjects

Index 4 Targets  Elementary-12  Middle School-13  High School (changed as of April 25 th posting)*  District--13  Districts, high schools, and multi- grade campuses (changed as of April 25 th posting)* STAAR ComponentAll four components

Indicator All Students Afric an Amer. Amer. Indian Asian Hispani c Pacific Islande r White Two or More Races ELL Special Ed. Total Points Max. Points STAAR Score STAAR % Met Final Level ll on Two or More Tests 29%16%40%23%38%36% STAAR Score (STAAR total points divided by maximum points)30 Graduation Score (Gr. 9-12) 4-yr. graduation rate 84.3%78.8% 91.6%86.0%44.2%69.8% yr. graduation rate 85.1%78.8%80.0%92.1%84.0%48.9%77.5% Highest Graduation Total Graduation Score (best of total graduation points divided by maximum points)78.0 RHSP/DAP Score 4-yr. graduation Percent RHSP/DAP 82.7%76.4%83.6%83.0% RHSP/DAP Score (best of total RHSP/DAP points divided by maximum points)81.4 Postsecondary/College-Ready Graduates Score College-Ready Graduates subject (ELA & Math) 82.0%72.0%78.0%89.0% College-Ready Score (total points divided by maximum points)80.2 Overall Index Score STAAR Score 30.0 Multipl y by Weight Graduation Score 78.0 RHSP/DAP Score 81.4 College-Ready Score 80.2 Index Score (sum of weighted index scores) Minimum Size is 25 STAAR Component: All Grade Levels Minimum Size = 25 This IS Index 4 for Elementary and Middle Schools

Elementary and Middle School Targets Targets are based on your campus configuration. (P. 15 of the Accountability Manual) Elementary is 12 Middle School is 13 High Schools who only have one component is 21 Districts who ONLY have the STAAR Component is 13.

Index 4 Data Tables Study: STAAR Component

Graduation Rates (or Annual Dropout Rate) Class of year Graduation Rate OR Class of year Graduation Rate (whichever is higher) OR Annual Dropout Rate for Grades 9-12 for campuses and students in Grades 9, 10, 11, or 12 (only if no graduation rate available)

Graduation Plan Component Recommended or Distinguished Plans 4-year Longitudinal Cohort (Class of 2013) Or Annual Percent if No Longitudinal Data

College Ready Graduates

Index 4 Construction: If All 4 Components are Included Average Your 4 Components: STAAR Component Graduation Rates Graduation Plans Post Secondary Indicator

Index 4 Construction: If All 4 Components are Included Targets: Districts57 High Schools/K-1257

Index 4 Data Tables Study: Graduation Rates, Plans, and Post Secondary Indicator

System Safeguards  Designed to Ensure that Student Group Performance is not Masked by A Performance Index Framework  Calculated from Index 1 Data, and Graduation Rates in Index 4  State Minimum Size: 25  Federal Minimum Size (for groups):  Performance and Participation is 25 and 10% or 200  Graduation Rates:  Federal Grad Rates Have an Improvement Target (P. 78)

76 IndicatorEntity All Students African Amer. Amer. Indian AsianHispanic Pacific Islander White Two or More Races Eco. Disadv. ELLSpecial Ed. Performance Rates* Reading State55% Federal79% n/a 79%n/a79%n/a79% Mathematics State55% Federal79% n/a 79%n/a79%n/a79% Writing55% Science55% Social Studies55% Participation Rates Reading95% Mathematics95% Federal Graduation Rates (including improvement targets) 4-year80% 5-year85% District Limits on Use of Alternative Assessment Results Reading Modified2%Not Applicable Alternate1%Not Applicable Mathematics Modified2%Not Applicable Alternate1%Not Applicable Texas Education Agency | Office of Assessment and Accountability | Division of Performance Reporting 2014 Accountability System Safeguard Measures and Targets * Targets for 2014 correspond to the performance target for Index 1: Student Achievement.

Looking Forward…  Class of 2014 will have TAKS scores for Post-Secondary Readiness Indicators  Graduation Plans will need to be redefined for Foundation Plans and Endorsements  EOC Retesters and OOS students???

Distinctions

Distinctions Available 2014  Campuses:  Academic Achievement in Reading/ELA  Academic Achievement in Math  Academic Achievement in Science*  Academic Achievement in Social Studies*  Top 25%: Student Progress  Top 25%: Closing Performance Gaps*  Campuses and Districts:  Postsecondary Readiness*

Comparison Groups  Campuses and Districts are ranked in a comparison group with 40 comparable schools  The Quartile is notated on your Distinction Tables (Q1, Q2, Q3, Q4)  Being in Top Quartile Contributes to the Distinction

Calculations  Academic Achievement in Reading/ELA, Math, Science, Social Studies, and Science:  High Schools: Q1 in at least 1/3 of Indicators  Middle/Junior High/Elementaries: Q1 in at least ½ of Indicators  Attendance Plus One Other Indicator Required

Example

Top 25% Distinctions  Top 25% in Student Progress  Top 25% Closing Achievement Gaps  Campuses are ranked with their comparison groups  High Schools are not eligible this year for Top 25% Student Progress because they don’t receive an Index 2 score

Post Secondary Readiness  Elementary/Middle/Junior Highs Have 1 Indicator: Index 4 STAAR Component  They are ranked with their comparison group and earn a Distinction for Top 25%  High Schools and K-12 Have 8 Indicators and Must be Q1 in at least 1/3 of the Indicators  Districts Must Have at Least 70% of Campus- Level Indicators in Q1

Final Ratings Overview  What areas are strengths and weaknesses for your district?  What answers do your reports provide?  What questions do they create?  What are your next steps?  What support do you need from Region X?