Understandin g the API & the AYP APLUS+ Annual Conference October 2010 Del Mar, California Diane Grotjohn

California And the Feds California Academic Performance Index Established by PSAA in 1999 Measures growth Moving Target Federal Annual Yearly Progress Established by NCLB Act in 2001 Measures progress towards a set goal All schools have same goal APLUS+ Conference October

Uses of the API Ranks schools Measures progress of state intervention programs Is part of Adequate Yearly Progress Provides public information on school improvement Determines eligibility for awards Is only valid as growth measure from one year to the next (can not be compared long-range) APLUS+ Conference October

Growth API For school and district: 5% of difference between API and ‘interim’ growth target of 800. –Minimum growth target for any school is 5 until school has 796 API –PSAA law says that those who do not make growth are underperforming For subgroups: –Until 2007: 80% of school or district’s growth –Now: 5% of subgroup’s difference between API and 800 –PSAA law says that lack of sufficient growth in ANY subgroup means the whole school is underperforming. APLUS+ Conference October

Growth Targets for API Growth Target: Schoolwide or Subgroup Base API: 200 – Schoolwide or Subgroup 5% difference between base API and point gain pts pts pts pt Maintain 800 or more APLUS+ Conference October

API Target Calculation APLUS+ Conference October Maximum 1000 Target 800 Example School 535 Minimum % x ( ) = 13 Growth Target 5% of the Distance to the Statewide Performance Target

Required Components of API* CAPA – California Alternate Performance Assessment CMA – California Modified Assessment CST– California Standards Test CAHSEE – California High School Exit Exam APLUS+ Conference October *Include when valid and reliable

API for Schools, Districts, and Subgroups Two APIs each year: Base and Growth Base API is used for ranking deciles.(Feb- Mar) Growth API shows changes in most recent testing (Fall) Since 2001, a new API calculation formula each year. Year to year comparisons are not valid. Can only compare growth rates, not API score District API (base and growth) since 2003 APLUS+ Conference October

Example: Assessment Changes APLUS+ Conference October

API Performance Level Weighting Factors APLUS+ Conference October Note: A Weighting Level of 200 is “assigned” to “untested” students in grade Math and 9 – 11 grade Science

2007/2008 and 2008/2009 API Test Weights Grades 2-8 APLUS+ Conference October Note: Test weights are not shown as percentages and do not total Content Area 2009–10 API Test Weights CST/CMA/CAPA in ELA, Grades 2–80.48 CST/CMA/CAPA in Mathematics, Grades 2–80.32 CST/CMA/CAPA in Science, Grades 5 and CST in History–Social Science, Grade Assignment of 200, CST in Mathematics, Grade 80.10

2008/2009 API Test Weights Grades 9-12 APLUS+ Conference October Content Area API Test Weights CST/CAPA in ELA, Grades CST/CAPA in Mathematics, Grades CST in Science, Grades CST/CAPA in Life Science, Grade CST in History-Social Science, Grades CAHSEE ELA, Grades CAHSEE Mathematics, Grades Assignment of 200, CST in Mathematics, Grades Assignment of 200, CST in Science, Grades Note: For CAHSEE, grades eleven and twelve are counted only if the student passed. Test weights are not shown as percentages and do not total 1.00.

APLUS+ Conference October

APLUS+ Conference October

APLUS+ Conference October

APLUS+ Conference October /2010 API Overview, 9 – 12 Schools

“Assignment of 200” What is it? A score of 200 is assigned to every student who does not have a valid score in –CST-Math (grades 8-11 ) A test weight of 0.10 is used in the API calculation instead of 0.32 (grade 8) or 0.20 (grades 9-11) –CST-Science (grades 9-11) a test weight of 0.05 is used in the API calculation instead of 0.22 APLUS+ Conference October

Math Rules Rules for Grades 8-9 CST in General Math: APLUS+ Conference October  For grade 8, the performance level of the student record is lowered by one performance level  For grade 9, the performance level of the student record is lowered by two performance levels

Scale Calibration Factor Designed to “maintain consistency” in statewide average API from one reporting cycle to the next The “SCF” is calculated for each grade span Difference between statewide average Growth and Base API’s for the same year’s test data Added to school, LEA, subgroup API Does NOT preserve comparability across reporting cycles Can not accurately compare year-to-year scores 9/20/

Subgroups Numerically significant subgroups ALSO have Base and Growth APIs. –“Numerically significant” if either: 100 students in group 50 students in group, which is at least 15% of total student population Numerically significant subgroups all must grow 5% of the difference of the subgroups previous year’s API and 800. “Comparable Improvement” or “CI” is now included in API reports. APLUS+ Conference October

APLUS+ Conference October Subgroup Determination

English Learners Who counts, and when? –If in US less than one year, doesn’t count for proficiency on AYP March 15 is cut off date –Does count in API and in participation rates for AYP –Is included in API calculations, but NOT in EL subgroup API APLUS+ Conference October

Reclassified Fluent-English- Proficient (RFEP) Included in EL subgroup UNLESS –Scored Proficient or above on ELA CST for 3 years –If not marked, ETS assumes “yes” Not counted to determine if subgroup is numerically significant NOTE: Verify the accuracy of demographics with ETS – if not identified, they will assume not in subgroup APLUS+ Conference October

So, Exactly, WHO counts? All students enrolled on first day of testing –With some exceptions... APLUS+ Conference October

How is “Enrollment First Day of Testing” Determined? Is there a test document for the student? (See flow chart page 31) APLUS+ Conference October

How is “Number Tested” Determined? Was the student “enrolled on the first day of testing”? Did the student take any portion of any test? (Flow chart p. 32) APLUS+ Conference October

How is “Valid Scores” Determined? Is the student included in “number students tested”? Was the student continuously enrolled for the academic year? APLUS+ Conference October

Including the CAHSEE All 10 th graders enrolled at “census” count All 11 th and 12 th grade passers count (Flow Chart p. 35) APLUS+ Conference October

Inclusion/Exclusion Rules  Mobility  Completely Blank Test  Irregularity  Unmatched Score  Accommodations/Modifications  Special Testing Conditions APLUS+ Conference October

Inclusion/Exclusion Rules Mobility If a student has been continuously enrolled in a school from the October CBEDS date to the testing date, the student is counted in the school API. English learners enrolled in a U.S. school for less than a year are not counted in the school or LEA API (matches AYP calculation rules). APLUS+ Conference October

Inclusion/Exclusion Rules Completely Blank Test If a student record shows no scores or items attempted on any part of the CST, and CAPA used in API, the entire STAR Program student record is not included in API. Exceptions: If a student record shows “Tested but Marked No Answers” (Code Z) for any content area, the content area is included and assigned a weight of 200 APLUS+ Conference October

Inclusion/Exclusion Rules Completely Blank Test Exceptions (continued): CAHSEE grade 10 student census (February or March) record showing “Blank/ Not Attempted” for one or both content areas is included and assigned a weight of 200 for content area(s). Blank records for grades 11 and 12 are excluded. APLUS+ Conference October

Inclusion/Exclusion Rules Accommodations CST or CAHSEE: Accommodations do not effect score APLUS+ Conference October Note: This rule is the same for AYP calculations.

Inclusion/Exclusion Rules Modifications for API CST or CAHSEE: The score is included for the content area and assigned a weight of 200. The “ Matrix of Test Variations, Accommodations, and Modifications for Administration of California Statewide Assessments ” can be found at APLUS+ Conference October

Inclusion/Exclusion Rules Modifications for AYP CST or CAHSEE: Counted in AYP participation rate as “not tested Not counted in AYP percent proficient APLUS+ Conference October

Statewide Ranking Schools ranked 1 to 10; 10 is best. Half of all schools will always be underperforming. Always. Greater API growth is needed to move out of decile1 or 2 than deciles 5, 6, 7. If you stand still, others will pass you by. APLUS+ Conference October

API Ranks Ranks are established by deciles. Base API is used to establish ranks A school’s rank may, or may not, improve if API improves depending on what other schools did. LEAs and ASAM schools receive API scores, but do not receive ranks Small schools (<99 valid scores) do not receive similar school ranks APLUS+ Conference October

APLUS+ Conference October

“School Type” for API Ranks are calculated separately by school type Schools are compared by “type” 3 “types”: –Elementary, Middle, and High –Based on lowest and highest grade in which a student was reported at CBEDs APLUS+ Conference October

My school doesn’t “fit” a “type” School type is based on enrollment in “core grade spans” –Elementary: K-5 –Middle: 7 – 8 –High: Some (very few) schools are assigned “type” based on name or characteristics If Base API school type is different from Growth API school type, districts are given opportunity to change APLUS+ Conference October

Similar School Rank Variables APLUS+ Conference October

Similar School Ranks Determine school type: Elementary, Middle, High Calculate School Characteristics Index (SCI) Sort schools by SCI. Find 50 schools above and 50 below target school. Using identified similar schools, sort schools by API. Identify deciles. APLUS+ Conference October

AYP APLUS+ Conference October

And for AYP…. Four requirements: –Participation Rates –Percent Proficient –Graduation Rate –API as “additional indicator” APLUS+ Conference October

Schools are “underperforming” if School or any subgroup misses any target If miss same target for 2 years, go into Program Improvement (Unless not a Title 1 school) Get out of PI if meet all targets for 2 years Number of schools in PI in California is growing each year APLUS+ Conference October

AYP Targets for 2010 Percent Proficient for K-8 –ELA: 56.8 –Math: 58.0 Percent Proficient for High Schools –ELA: 55.6 –Math: 54.8 Minimum API of 680 –Or growth of at least 1 point Graduation Rate –90% or –Fixed growth rate or –Variable growth rate APLUS+ Conference October

AYP Proficiency Targets Over Time APLUS+ Conference October

Four-Year Graduation Rate Formula for ESEA Graduation Rate for 2010 Number of Graduates (2008–09) divided by Number of Graduates (2008–09) + Grade 9 Dropouts (2005–06) + Grade 10 Dropouts (2006–07) + Grade 11 Dropouts (2007–08) + Grade 12 Dropouts (2008–09) APLUS+ Conference October

APLUS+ Conference October Assessments Used in API/AYP CSTCMA CAP A CAHSE E Grade level ELA Writing Math General Math Algebra 1, Geomet ry, Algebra 2, Integrat ed Math 1, 2, or 3, Summat ive Math History- Social Science Science Biology, Chemist ry, Physics, Earth Science, Integrat ed Science 1,2,3, or 4 English/ Langua ge Arts Math Science ELA, Math See Note 2a See Notes 2b-2d See Notes 3a- 3b See Note 4a See Note 4b See Notes See Notes #1 2X, I, Y CSTCMACAPA CAHS EE Note 2a Notes 2b-2d Notes 3a- 3b Note 4a Note 4b See Notes Added 2009 Notes 1 a-d 2X, I, Y SPED, I, Y 3X, I, Y SPED, I, Y 3X, I, Y 4 SPED, I, Y 4X, I, Y 5 X, I SPED, I, Y SPED, I 5X, I, Y 6 I SPED, I, Y 6X, I, Y 7 I SPED, I, Y 7X, I, Y 8 X, I-1, Y or X, I, Y X (US), IX, I SPED, I, Y SPED, I SPED, I, Y SPED, I 8X, I, Y X, I-1, Y or X, I, Y 9X, I X, I-2 or X, I X (Wld), I I SPED, I 9X, I X, I-2 or X, I 10X, I I X(Wld, US), IX, I I SPED, I, Y SPED, IX, I, Y 10X, I 11X, I I XN(W ld), I I SPED, I X, I 11X, I 12 X, I 12

Thank you! APLUS+ Conference October