Presentation on theme: "1 TETN Accountability Update Session November 15, 2007."— Presentation transcript:
1 TETN Accountability Update Session November 15, 2007
2 State Accountability Update
3 Recent and Upcoming Events November 15AEIS release on TEASE November 28AEIS release on TEA public website December 6PEG release on TEASE December 11School Report Cards (SRCs) released (target) December 12Public Education Grant (PEG) list (target)released on TEA Correspondence Site Mid-December Pocket Edition published (web and print)
4 Gold Performance Acknowledgments
5 Among the campuses that were evaluated for GPA: 18% earned exactly 1 18% earned exactly 2 14% earned exactly 3 78% earned 1 or more 59% earned 2 or more
6 Gold Performance Acknowledgments (continued) Among the districts that were evaluated for GPA: 16% earned exactly 1 17% earned exactly 2 12% earned exactly 3 76% earned 1 or more 60% earned 2 or more
8 Gold Performance Acknowledgment (continued) GPA Indicators Recommended High School Program (RHSP)/ Distinguished Achievement Program (DAP) >= 80.0% 10 SAT/ACT Results (College Admissions Tests) >= 70.0% and >= 40.0% (new SAT reading and mathematics only) 11 Texas Success Initiative: Higher Education Readiness Component- English Language Arts 50% 12 Texas Success Initiative: Higher Education Readiness Component- Mathematics 50% Comparable Improvement (campus only acknowledgments) Reading/ELA Mathematics Top Quartile (top 25%)
9 Gold Performance Acknowledgments (continued) The number of campuses and districts earning acknowledgment on the RHSP indicator continues to decline. RHSP/DAP # campus earned % campus earned8.8%6.5%4.8% # district earned % district earned42.9%31.7%22.1%
10 Gold Performance Acknowledgments (continued) At the district level, the number of districts earning acknowledgments declined for every GPA indicator, except the two TSI indicators. The biggest decline was in commended performance on writing. There are 208 fewer districts commended on writing than in The greatest increase was for the TSI in ELA where there are 266 more districts earning this acknowledgment.
11 Gold Performance Acknowledgments (continued) At the campus level, the number of campuses earning acknowledgments declined for 8 of the possible 14 GPA indicators. The biggest decline was in commended performance on mathematics. There are almost 600 fewer campuses commended on mathematics than in The greatest increase was for the TSI in ELA where there are 307 more campuses earning this acknowledgment.
12 Technical Assistance Teams
13 TAT Methodology The TAKS data was rebuilt for both and to include selected TAKS-Inclusive grades and subjects and to include grade 8 science results. These data are reported on the AEIS reports as a Preview Indicator (example to follow). SDAA II results are not evaluated. Paired campuses and obsolete campuses are removed from the TAT list. There is no waiver provision for the TAT list.
14 TAT Facts There are 395 unique districts with one or more campuses on the TAT list. This compares to 157 unique districts on the list. Most districts have only one campus on the list (62%). Houston ISD has the most campuses of any single district, with 56. The most common campus type on the list is Middle School with 40% (among the Both, Elementary, Middle School, and Secondary categories). The TAT list had 234 campuses, with 35 waivers, so only 199 campuses had TAT requirements. The list is almost four times as large with 877 campuses and no waivers.
15 The TAT Data The AEIS reports (released to superintendents today through the TEASE site) contains a 2008 Preview Indicator. Economically. Disadvantaged = All Students
16 The TAT Data (continued) The 2008 Preview Indicator is the data that was used to identify campuses for the TAT list. The TAT processing also evaluated student group size, checked for requirement improvement, and applied the Exceptions Provision. These details cannot be discerned from the Preview Indicator.
17 TAT Consequences Questions about TAT membership should be directed to the PMI Division at Team membership should be submitted by November 30, 2007.
18 TAT FAQs Why is a certain school on the list? See the AEIS 2008 Preview Indicator. I have a school on the list. What must I do now? Identify your TAT membership and submit name(s) to the PMI Division. Is this particular person eligible to be a team member? Contact PMI.
19 TAT FAQs (continued) I cant reconcile my data with your data. How did you get the results you used? We recomputed both the 2007 data and the 2006 data to include grade 8 science results at the PR level as well as TAKS-I (science and social studies and grade 11). Will the agency provide data in the future? No recomputation of data is necessary next year, so August 1 Accountability Data Tables can be used. Reasons will be provided on the TAT list. It is also anticipated that notification will occur via TEASE instead of via mailing.
20 TAT FAQs (continued) I have a 2007 granted appeal based on data quality issues, yet you evaluated me for the TAT list based on the bad data anyway. Why? Even with granted appeals the underlying data are not altered. The 2007 data was the only performance data available to evaluate against the 2008 system criteria.
Academic Excellence Indicator System (AEIS) Update
22 November 15 TEASE release notification was sent November 14 to district superintendents with a copy to ESC directors. The TEASE site provides everything districts need to fulfill statutory requirements associated with AEIS. Site also provides Guidelines and Glossary. Unlike other TEASE products, the AEIS reports are NOT confidential.
23 District Responsibilities (See Guidelines for details) PUBLISHING MUST publish: performance and profile sections of district and campus AEIS reports MAY publish: Glossary (Note: Spanish language translation of the Glossary will be available in January 2008) MUST ADD and publish: Campus performance objectives Report of violent or criminal incidents Information from THECB about performance of students in postsecondary institutions
24 District Responsibilities (continued) HEARING FOR PUBLIC DISCUSSION Must be held within 90 calendar days after the November 15 th TEASE release. District winter break days do not count toward the 90 days. Within 2 weeks after the hearing, the AEIS report must be disseminated.
25 District Responsibilities (continued) DISSEMINATION OF THE REPORT May be accomplished by: Directing readers to copies of the reports located on the districts website (preferred). Directing readers to the TEA AEIS website. Through mailouts. By posting the report in public places.
26 District Responsibilities (continued) AEIS AND THE DISTRICT WEBSITE TEC requires the district to post the most current AEIS report by the 10th instructional day. There is no requirement in this statute that district websites must be updated with new AEIS reports after the 10th instructional day; however, districts are encouraged to do so. See our FAQ about this requirement at:
27 November 28 Public Release Includes the TEASE products; namely, individual district and campus AEIS reports, CI reports, Glossary, and Guidelines. ADDS: Region reports State report A separate report of how mobile students performed (state- level only) Data download (including explanation of masking) Additional CI information The Multi-Year feature Direct links to prior year reports Direct links to grade level Progress of Prior Year Failers
28 Changes to AEIS Accountability Preview of 2008: An indicator is included that shows TAKS performance constructed to reflect the indicator definition that will be used in the 2008 accountability system. This indicator is titled, TAKS Met 2008 Standard (Sum of All Grades Tested, INCLUDING grade 8 Science and TAKS-I2008 Preview at Panel Recommended). Participation: TAKS-Alternate Only and Combination have been added to the tested subsection.
29 Changes to AEIS (continued) TAKS-Inclusive: TAKS-I results, previously reported as a separate indicator, have been deleted. The TAKS-I results (for selected subjects and grades) are now included with other TAKS data in the Accountability Preview indicator described above. TAKS-I results are not included in the TAKS results by grade. Although TAKS-I has been renamed TAKS (Accommodated), the AEIS reports and Glossary use TAKS-I.
30 Changes to AEIS (continued) Annual Dropout Rate: The annual dropout rate for grades 9-12 is added. All three annual dropout rates (7-8, 7-12, and 9-12) will appear on each district, region, and state report. However, only the 7-8 and 9-12 rates will appear on campuses evaluated under standard procedures. The 7-8 and 7-12 rates will appear on campuses evaluated under AEA procedures. Due to definition changes to the annual dropout rate, only the current year of dropout data is shown.
31 Changes to AEIS (continued) College-Ready Graduates: A new indicator of college readiness is added to the college-ready section of the report. To be considered college-ready, a graduate must have achieved a certain performance level on any one of the following tests: the exit-level TAKS, the SAT, or the ACT. English Language Learners Progress Measure: For the first time, two years of information are available for this indicator ( and ). Also, more details are provided for the definition of this indicator in a new appendix to the Glossary, Appendix H.
32 School Report Card Summary
33 Overview A subset of the AEIS Governed by its own statute (TEC ) and Commissioners Rule (TAC ) Intent is for this report to get to the homes of each child
34 Delivery & Notification from TEA A website release only. Paper copies not mailed. Web products are accessible through the AEIS site no separate TEASE release. Target release date – December 11. Superintendents and principals notified of availability via .
35 District Responsibilities Districts must provide SRCs to their campuses. Must be disseminated to parents within six weeks after districts are notified by TEA. The district winter break doesnt count toward the six week period. There are various ways to achieve the distribution requirements (see TAC ). Supplemental materials are provided by TEA o Sample cover letters to parents (English and Spanish) o Definitions (English and, as soon as available, Spanish)
36 Public Education Grant (PEG) Program – Summary
37 Overview A statutorily-mandated program of school choice (TEC Ch. 29, Subchapter G, ). Statute addresses campus identification, funding issues, and student eligibility issues.
38 Criteria Partially tied to accountability ratings, but not aligned with either the state system, AYP, or the TAT list. PEG criteria are tougher on the evaluation of science and math results than the state standards currently are. There is a 3 year moving time period, so even improved schools stay on the list if they were AU in any of the previous three years. The number of campuses anticipated this year is expected to be lower than last year. Last year there were 924 schools identified.
39 Calendar and Notification Planned release on December 6 via TEASE to all districts with one or more campuses on the list. List will be posted to agency website on December 12. An online FAQ is available through the Division of Performance Reporting Resources link
40 District Responsibilities Statute requires that districts notify parents of the list by February 1 of List is based on 05, 06, and 07 performance, but is in effect for the school year.
AEA Campus Registration Process - Reopened
AEA Campus Registration Process - Reopened The initial 2008 AEA campus registration process was conducted online using the TEASE Accountability website September 10-21, An message was sent on September 7, 2007 informing district superintendents of the 2008 AEA registration process. Due to a network problem, this was not delivered until September 27, after AEA registration had closed. To ensure an AEA registration process that is administered fairly and consistently for all campuses, the online 2008 AEA campus registration process is reopened November 12-28, 2007.
AEA Campus Registration Process - Reopened (continued) Forms submitted online during the September registration window will remain in effect for the school year. Do not resubmit 2008 AEA registration or rescission forms submitted September Verify that AECs are pre-registered using the 2008 Pre-Registered AEC List at AECs requesting AEA registration must complete an electronic AEA Campus Registration Form. AECs for which 2007 AEA registration was rescinded due to not meeting the at-risk registration criterion must submit an electronic AEA Campus Registration Form if the AEC wishes to request AEA registration in 2008.
AEA Campus Registration Process - Reopened (continued) AECs wishing to rescind AEA registration must complete an electronic AEA Campus Rescission Form. AEA rescission and registration forms submitted via TEASE Accountability must be printed and maintained by superintendents as official documentation of AEA campus registration requests. The reopened 2008 AEA campus registration process closes at 5:00 p.m. CDT on November 28, AEA registration and rescission forms will not be processed after this time. The 2008 Registered AEC List will be posted online at in December.
45 Federal Accountability Update
AYP Release Schedule Tuesday, December 11 (target date) o AYP Appeals letters mailed o Appeal letters posted on TEASE Tuesday, December 18 (target date) o AYP release on TEA public website
Assessments and AYP TAKS Same as 2007 LAT TAKS Same as 2007 TAKS-Accommodated Included in AYP for Reading and Math
Assessments and AYP TAKS-Modified Included in AYP for Reading and Math Students taking TAKS-M are o included in Participation, o included in Performance subject to a 2% cap on proficient results TAKS-Alternate Included in AYP for Reading and Math Students taking TAKS-Alt are o included in Participation, o included in Performance subject to a 1% cap on proficient results
Assessments and AYP TELPAS Reading Same as 2007 Students in their First Year in US Schools are o Included in Participation o Excluded from Performance Students in their Second or Third year (or more) of enrollment in U.S. schools are o Not counted as participants (Non-Participants) o Excluded from Performance
AYP Preview: Federal Cap In general, the federal cap process has been applied to Texas schools in the following steps: Determine the districts total participation count, based on the school districts total participation denominator for the Reading/English Language Arts and Mathematics. This count is based on students identified as enrolled on the day of testing in grades 3 – 8 and 10 only. Apply the percentage to the total participation count for the cap limit on 1% or 2% proficient results. District Participation Denominator x.01 = TAKS-Alt Limit District Participation Denominator x.02 = TAKS-M Limit
AYP Preview: Federal Cap (continued) In past years, TEA determined how many proficient scores could be included in the performance rates for each district based on a sorting priority. All students in the school district were sorted in the order of priority regardless of the campus identification.
AYP Preview: Federal Cap (continued) Proficient scores that remain after the district cap was reached were counted as non-proficient for AYP purposes only. Since the limit of proficient results in the federal cap has been based on the school district participation count, it is difficult to determine the specific campus results of the federal cap calculation.
AYP Preview: Federal Cap (continued) An Important Note about Alternate Test Administration It should be emphasized that the federal cap relates to counting students as proficient for AYP purposes only and does not provide direction to ARD committees regarding how students with disabilities should be assessed. For students with disabilities receiving special education services, state policies and procedures related to assessment decision-making are detailed in the TEA publication titled Admission, Review, and Dismissal (ARD) Committee Decision-Making Process for the Texas Assessment Program. It is important that local school districts ensure that appropriate assessments are selected and administered to students with disabilities.
AYP Preview: Federal Cap (continued) The protocol for determining which students are included or excluded in AYP if the 1% or 2% caps are exceeded has not yet been determined. Ongoing research to determine how other states are planning to process proficient results that exceed the cap.
AYP Preview: Federal Cap (continued) The USDE federal regulation released in April 2007 provides specific guidelines on the implementation of the federal cap: Districts cannot exceed the 1% cap for TAKS- Alt. However, if they do not fully use the 1% cap, then they can exceed the 2% cap (up to 3%). In other words, TAKS-M proficient scores may spill over beyond the cap, but the TAKS-Alt may not.
AYP Preview: Federal Cap (continued) One Possible Scenario: Subject Area: Reading/ELA Total Number of AYP Participants in District = 742 (Grades 3 – 8 & 10 only) 1% x 742 = students may be counted as proficient in AYP from TAKS-ALT 2% x 742 = students may be counted as proficient in AYP from TAKS M 3% is the total number of students, or 23
AYP Preview: Federal Cap (continued) Second Scenario: Subject Area: Reading/ELA Total Number of AYP Participants in District = 742 (Grades 3 – 8 & 10 only) 1% x 742 = 7.42 from students may be counted as proficient in AYP from TAKS-ALT 2% x 742 = from students may be counted as proficient in AYP from TAKS M The combined total is 23 students, or 3%
AYP Preview Timeline Standard setting for the TAKS-M assessment will not be completed until August Discussions have begun with the USDE to modify the 2008 AYP timeline. Texas will request that the preliminary 2007–2008 AYP status and the corresponding 2008–2009 School Improvement Program (SIP) status be released after the beginning of the 2008–2009 school year.
AYP Preview (continued) The 2008 Adequate Yearly Progress (AYP) Guide will include the details of the federal cap process and 2008 timeline. The AYP Guide will be available on the Texas Education Agency website in late spring Examples like those in the AYP Information Packet, available from the TEASE Accountability website, may be incorporated into the AYP Guide federal cap process description.
60 State and Federal Accountability School Year
61 TAKS (Accommodated) StateFederal Reading/ELA (grades 3 – 8 and 10) Reading (grades 3 – 6 Spanish) Mathematics (grades 3 – 8 and 10) Mathematics (grades 3 – 6 Spanish) Report only Indicator in AEIS/ Not used in State Ratings Use in AYP Reading (grade 9) Mathematics (grade 9) Writing (grades 4 and 7) Writing (grade 4 Spanish) Report only Indicator in AEIS/ Not used in State Ratings Not used in AYP ELA (grade 11) Mathematics (grade 11) Science (grades 5, 8, 10, and 11) Social Studies (grades 8, 10, and 11) Use in State Ratings Not used in AYP
62 TAKS-Modified (TAKS-M) StateFederal Reading/ELA (grades 3 – 8 and 10) Mathematics (grades 3 – 8 and 10) Report only Indicator in AEIS (TBD)/ Not used in State Ratings Use in AYP Science (grades 5, 8, and 10) Report only Indicator in AEIS(TBD)/ Not used in State Ratings Not used in AYP Field Tests: Reading (grade 9) ELA (grade 11) Mathematics (grades 9 and 11) Science (grade 11) Social Studies (grades 8, 10, and 11) Not Reported in AEIS/ Not Used in State Ratings Not used in AYP
63 TAKS-Alternate (TAKS-Alt) StateFederal Reading/ELA (grades 3 – 8 and 10) Mathematics (grades 3 – 8 and 10) Report only Indicator in AEIS / Not used in State Ratings Use in AYP Reading (grade 9) ELA (grade 11) Mathematics (grades 9 and 11) Writing (grades 4 and 7) Science (grades 5, 8, 10 and 11) Social Studies (grades 8, 10, and 11) Not Reported in AEIS/ Not Used in State Ratings Not used in AYP
64 TETN Accountability Update Sessions 2008 Dates and Tentative Agenda Topics February 29 Update on Accountability Development April 3 Accountability Decisions for 2008 & Beyond June 11 Accountability Manuals – State and AYP August 14 Accountability Results for 2008 November 13Accountability Ratings Update Gold Performance Acknowledgments AEIS Reports School Report Cards PEG List The above dates are for 1 p.m. to 3 p.m.
65 Accountability Resources the Division of Performance Reporting at Phone the Division of Performance Reporting at (512) ESC Accountability Contacts. Online: ACCT: AEA: AYP: