1. 2006 Accountability Manual May 23, 2006

2. 1 Introduction Selected sections are adopted as Commissioner of Education rule These sections have been posted to the 2006 accountability site at: www.tea.state.tx/us/perfreport/account/2006/manual www.tea.state.tx/us/perfreport/account/2006/manual Remaining sections (the Preview and Appendices) will be posted on 5/25/06 Email notification will be sent 5/25/06

3. 2 Introduction (contd) Manual Orientation Manual Highlights (Standard Procedures) 2006 Accountability Schedule

4. 3 Manual Orientation Part I – Standard Procedures Part II – Alternative Education Accountability Procedures Part III – Items common to Standard and AEA Procedures Appendices

5. 4 Manual Orientation (contd) Part I – Standard Procedures Overview (Chapter 1) The Basics Base Indicators (Chapter 2)* Additional Features (Chapter 3)* Determining a Rating (Chapter 4)* GPA (Chapter 5)* Special Issues/Circumstances (Chapter 6)* * Adopted in Commissioner's rule

6. 5 Manual Orientation (contd) Part II – AEA Procedures Overview (Chapter 7) Registration Criteria (Chapter 8)* Attribution of AEC data (Chapter 9) Base Indicators (Chapter 10)* Additional Features (Chapter 11)* AEA Ratings (Chapter 12)* Index (Chapter 13) * Adopted in Commissioner's rule

7. 6 Manual Orientation (contd) Part III – Items Common to Standard and AEA Procedures Appeals (Chapter 14)* Responsibilities and Consequences (Chapter 15)* 2007 Standards (Chapter 16) [NEW CHAPTER]* Preview of 2007 and Beyond (Chapter 17) – This chapter combines the preview for both Standard and AEA procedures. Calendar (Chapter 18) * Adopted in Commissioner's rule

8. 7 Manual Orientation (contd) Appendices A: Texas Administrative Code (provides the text of the Commissioners rule) B: Statutory Citations C: Comparison to AYP D: Data Sources E: Texas Growth Index F: Campus Comparison Group G: Contacts H: Acknowledgments I: Hurricanes Katrina and Rita [NEW APPENDIX]

9. 8 Highlights of Manual The following tables or sections of the manual are recommended for bookmarking. These sections are noteworthy because: they are summaries or overviews of a topic; they are significantly changed from the previous edition; or, they describe something new

10. 9 Highlights of Manual (contd) Table 2 Comparison Provides a summary of changes to the 2006 System compared to the 2005 System. Excerpts reflect 2006 changes only:

11. 10 Highlights of Manual (contd) Component2006 Base Indicators for Determining Rating (Chapter 2) TAKS No Change SDAA II No Change Completion Rate IIChanged to Completion Rate I Dropout Rate No Change Rating Standards (Chapter 2) AcceptableRecognizedExemplary TAKS 35%/40%/60% 70%90% SDAA II No Change Completion Dropout TAKS Subjects Evaluated (Chapter 2) No Change (TAKS science for gr. 8 is assessed and reported, but not used for accountability) Table 2 Comparison

12. 11 Highlights of Manual (contd) Table 2 Comparison Component2006 TAKS Student Passing Standard (Chapter 2) Panel Recommendation for all subjects, all grades Student performance included for rating (Appendix I) Same as 2005; additionally, performance of students with KRI (Katrina-Rita Indicator) codes on TAKS/SDAA II is excluded from ratings calculation Required Improvement (Chapter 3) TAKS: No Change SDAA II: RI to Academically Acceptable and Recognized possible Completion Rate I: RI still possible; prior year will be re-computed as Completion Rate I Annual Dropout Rate: No Change Exceptions (Chapter 3) No Change (Exceptions applied in 2005 cannot be re-used in 2006)

13. 12 Highlights of Manual (contd) Table 2 Comparison Component 2006 Hurricane Rita (Appendix I) Schools and districts closed for ten or more days may receive a rating of Not Rated: Other. Gold Performance Acknowledgment Indicators (Chapter 5) Same as 2005, except: Addition of TSI - Higher Education Readiness Component for English Language Arts TSI - Higher Education Readiness Component for Mathematics Deletion of TAAS/TASP Equivalency Standards for GPA (Chapter 5) Same as 2005, except: Recommended High School Program is raised to 70.0%; Standard for the new TSI - Higher Education Readiness Component for Mathematics and ELA indicators is 50% Underreported Students (Chapter 3) No more than 100 underreported students; and, No more than 2.0% underreported

14. 13 Highlights of Manual (contd) Subset Scenarios The subset scenarios describe a variety of student mobility situations and explain how these students test results will be used for accountability. Location – In Chapter 2 – Base Indicators just after discussion of TAKS and SDAA II indicators (pp.16 – 19). Located here because subsetting only applies to these two base indicators. New subset table – Focuses on SSI grades. Located in Data Sources (p.172). Chart format rather than written description of situations.

15. 14 Highlights of Manual (contd) Ratings Table 4 (p. 34) Standard Rating Labels: provides description of all possible rating labels – what they mean and when they are applied. Table 5 (pp. 36-40) Sample Data Table: shows what district admin will see in July on TEASE. Shows how to use data provided to determine a rating. Note addition of prior year data and RI columns for SDAA II Note on preview table: no rating no messages no RI, Exceptions calculations Analysis Groups ARE MARKED

16. 15 Highlights of Manual (contd) System Summaries Tables 6 and 7 provide single page summaries of the 2006 system. Table 8 provides a summary of the GPA indicators. Table 6 - Requirements for each Rating Category (columns are the Rating Categories) Table 7 – Overview of 2006 System Components (columns are the Base Indicators) Table 8 – GPA Standards for 2007

17. 16 Highlights of Manual (contd) Appeals Calendar (Chapter 14, p. 117) June 20, 2006 Dropout/Completion Lists. Superintendents are given access to lists of official dropouts and lists of completion cohort membership. These reports provide a preview of the data that will be used to calculate the Annual Dropout Rate and Completion Rate I base indicators for the state accountability ratings. July 21, 2006 Preview Data Tables. Superintendents are given access to preview accountability data tables for their district and campuses showing all state accountability indicator data. Principals and superintendents can use these data tables to anticipate their campus and district accountability ratings. Appeals may be submitted by the superintendent after receipt of the preview data tables. August 1, 2006 Ratings Release. Due to the short timeline between the transmittal of the preview data tables and the ratings release date, no appeals will be resolved before the ratings release. August 18, 2006 Appeals Deadline. Appeals must be postmarked no later than August 18, 2006 in order to be considered. Late October, 2006 Ratings Update. The outcome of all appeals will be reflected in the ratings update scheduled for October, 2006. At that time the TEA website will be updated. A more detailed calendar can be found in Chapter 18 – Calendar.

18. 17 Highlights of Manual (contd) Chapter 16 - NEW – Accountability Standards for 2007 Table 19 – Standard Procedures Table 20 – AEA Procedures Chapter 17 – Preview of 2007 and Beyond See tables 22 and 23 for standards through 2010 Table 22 – Standard Procedures Table 23 - AEA Procedures

19. 18 Highlights of Manual (contd) Appendix I – Hurricanes Katrina and Rita Excluding Data for Displaced Students (use of KRI code values) The assessment results (performance) of students displaced due to either Hurricane Katrina or Hurricane Rita will be removed from the accountability data. The Katrina-Rita Indicator (KRI) code collected on the TAKS and SDAA II answer documents will be used to determine which scores to exclude. Students with KRI codes of 2, 3, 4, or 5 will be excluded from the assessment results used for accountability.

20. 19 Highlights of Manual (contd) Appendix I – Hurricanes Katrina and Rita Hurricane Rita Provision For identified districts and campuses, the accountability system will generate ratings using available data. If the 2006 ratings are not Academically Unacceptable and are equivalent to, or better than, the rating received in 2005, TEA will issue the new system-generated rating on August 1. For all others (meaning the 2006 rating is either Academically Unacceptable or lower than the rating received in 2005), TEA will issue a rating of Not Rated: Other on August 1. For these campuses and districts, a message will be included on the data table that states the Hurricane Rita Provision was used

21. 20 2006 Accountability Schedule ActivityDate Pairing relationships requested for identified campusesMar. 29 th -Apr. 28 th Commissioners final decisions for 2006 accountability system are posted onlineApr. 5 th 2006 Accountability Manual published (public web only)mid-May Districts receive confidential dropout and completion lists and rates from TEA (secure web only)Jun. 20 th (Tue) Districts receive confidential preview data tables from TEA (secure web only)July 21 st TEA begins accepting ratings appealsJuly 21 st TEA issues 2006 district and campus accountability ratings (secure and public web)Aug. 1 st (Tue) Last day to appeal 2006 state accountability ratingsAug. 18 th (Fri) Appeals panel meetinglate Sept. / early Oct. Final ratings releaseafter resolution of all appeals (secure and public web)late Oct. TEA issues 2006 Gold Performance Acknowledgments (GPA)late Oct. TEA releases 2005-06 AEIS reports to district superintendents (secure web only)early Nov. Release of 2005-06 AEIS reports on public websitelate Nov. TEA notifies districts of campuses identified under PEG criteria effective for the 2007-08 school year (via mail) (not applicable to charters or registered AECs) mid-Dec. TEA releases 2005-06 School Report Cardsmid-Dec.

22. Alternative Education Accountability (AEA) Procedures May 23, 2006

23. 22 At-Risk Registration Criterion An at-risk registration criterion will be phased in beginning in 2006. Each registered AEC must have a minimum percentage of at-risk students enrolled on the AEC verified through current-year PEIMS fall enrollment data in order to be evaluated under AEA procedures. The at-risk criterion will begin at 65% in 2006 and increase by five percentage points each year until it reaches 75% in 2008 where it is expected to remain.

24. 23 At-Risk Registration Criterion (contd) Safeguards are incorporated for those AECs that do not meet the at-risk requirement. 1.Prior-Year PEIMS At-Risk Data Safeguard: If a registered AEC does not meet the at-risk criterion in the current year, then it remains under AEA if the AEC meets the at-risk criterion in the prior year. For example, an AEC with an at-risk enrollment of 64% in 2006 and 65% in 2005 remains registered in 2006.

25. 24 At-Risk Registration Criterion (contd) 2.New Campus Safeguard: If a new campus is registered for evaluation under AEA procedures, then the AEC is not required to meet the at-risk criterion in its first year of operation. This safeguard provides an accommodation for new campuses with no prior-year data. 3.At-Risk Statewide Average Safeguard: The 2006 at-risk statewide average is 49%. If a registered AEC does not meet the 65% at-risk registration criterion and the two safeguards above are not applicable, then the AEC remains under AEA if the AEC has at least 49% at-risk in 2006. This safeguard is a one-year accommodation for the new at-risk registration criterion and applies in 2006 only.

26. 25 At-Risk Registration Criterion (contd) On April 26, letters were mailed (return receipt required) to the 17 AECs that did not meet the 2006 at-risk registration criterion informing them that the AEC shifted from AEA to standard accountability and that the AEC will be evaluated under 2006 standard accountability procedures. ESC Executive Directors and Accountability contacts were mailed copies of these letters. The Final 2006 Registered AEC list was posted on the AEA website on May 19. A total of 417 AECs will be rated under 2006 AEA procedures. A list of the 84 charter operators that will be rated under 2006 AEA procedures was also posted on the AEA website on May 19.

27. 26 At-Risk Registration Criterion (contd) A State Compensatory Education Questions and Answers (Q and A) document is on the TEA website at: http://www.tea.state.tx.us/school.finance/audit/ sce_presentation.html This Q and A addresses proper coding of at-risk students. Also, ESC Compensatory Education contacts can assist with at-risk questions.

28. 27 Attribution of Data to Registered AECs For 2006 accountability: Campus accountability subset determines attribution of AEC test data, but does not apply to exit-level retests. 2004-05 leaver data were attributed according to the 85- day rule for AECs that were registered for evaluation under AEA procedures in 2005. 2004-05 leaver data were attributed to the last campus of attendance for AECs that were not registered for evaluation under AEA procedures in 2005, but are registered in 2006. As required in statute, DAEP and JJAEP data are attributed to the students home campus.

29. 28 Attribution of Data to Registered AECs For 2007 accountability: Campus accountability subset determines attribution of AEC test data, but does not apply to exit-level retests. 2005-06 leavers are attributed to the last campus attended. The 85-day rule is phased-out completely for 2007 accountability and beyond.

30. 29 2006 AEA Standards TAKS Progress indicator remains 40%. SDAA II indicator remains 40%. Completion Rate II indicator (includes graduates, continuing students, and GED recipients) remains 75.0%. Annual Dropout Rate (Gr. 7-12) indicator remains 10.0%.

31. 30 2006 TAKS Progress Indicator For 2006, exit-level results from the June and December 2005 administrations will be included. TAKS Tests Included April 2006 Feb 2006 Dec 2005 Oct 2005 July 2005 June 2005 Grades 3-11 Grade 11 Retests Grade 12 All tests

32. 31 SDAA II Required Improvement In 2006 and 2007, the Required Improvement feature will be added to the SDAA II indicator allowing registered AEC and charter ratings to move from AEA: Academically Unacceptable to AEA: Academically Acceptable. As with the other three AEA indicators, the SDAA II Required Improvement calculation is based on meeting the SDAA II indicator standard in two years.

33. 32 2007 AEA Standards TAKS Progress indicator increases to 45%. SDAA II indicator increases to 45%. Completion Rate II indicator (includes graduates, continuing students, and GED recipients) remains 75.0%. Annual Dropout Rate (Gr 7-12) indicator remains 10.0%.

34. 33 NCES Dropout Definition The dropout definition is transitioning from the current state definition to the National Center for Education Statistics (NCES) definition. Beginning with 2005-06 dropouts reported in 2006-07 and used for 2007 accountability, the definition of a dropout will change to comply with the NCES dropout definition. In 2007, only one of the four years in the cohort will be affected. In 2008, two years of the cohort are affected, and so on, until 2010 when the denominator uses the NCES dropout definition for all four years of the cohort.

35. 34 2007 Annual Dropout Rate Indicator Required Improvement (RI) for the Annual Dropout Rate indicator cannot be calculated and will not be applied in 2007. The changes to the dropout definition will prevent comparisons of rates used in 2006 and 2007. Due to the definitional and RI changes described above, if the Annual Dropout Rate is the only indicator causing a registered AEC or charter to be AEA: Academically Unacceptable, then the hold harmless provision is applied and the AEC or charter will be assigned the AEA: Academically Acceptable label. This provision will be in place for 2007 only.

36. 35 2007 Completion Rate II Indicator Required Improvement for the Completion Rate II indicator cannot be calculated and will not be applied in 2007. The changes to the dropout definition will prevent comparisons of rates used in 2006 and 2007.

37. 36 2007 AEA Campus Registration Process The 2007 AEA campus registration process begins on September 11, 2006. An email notification will be sent to all superintendents stating that AECs rated in 2005-06 under AEA procedures will be re-registered automatically in 2006-07 subject to the 70% at-risk registration criterion. A rescission letter will be required from AECs not wishing to remain registered for AEA.

38. 37 2007 AEA Campus Registration Process A 2006-07 AEA Campus Registration Form will be required from each AEC that wishes to be evaluated under 2006-07 AEA procedures that is not already on the list of registered AECs. A sample rescission letter and the registration form will be available on the AEA website at http://www.tea.state.tx.us/aea. AECs not meeting the 2006 at-risk registration criterion that wish to be evaluated under 2007 AEA procedures will be required to register in 2007. The 2007 registration process closes on September 22, 2006. When finalized, the list of 2007 registered AECs will be available on the AEA website.

39. 38 AEA FAQ The AEA FAQ has been updated and will be reposted on the AEA website by May 25, 2006 along with the 2006 Accountability Manual.

40. 39 Dates for Future TETN Accountability Sessions June 27 – tentative agenda topics: Update on the 2006 Special Session Overview of the decisions reached with the USDE on 2006 AYP Review of 2006 AYP Guide Review Plans for August 1 Release August 22 November 14

41. 40 Contact Information Phone:512-463-9704 Email: performance.reporting@tea.state.tx.usperformance.reporting@tea.state.tx.us Online:http://www.tea.state.tx.us/accountabilityhttp://www.tea.state.tx.us/accountability http://www.tea.state.tx.us/aea/ http://www.tea.state.tx.us/ayp/