1. Understandin g the API & the AYP APLUS+ Annual Conference October 2010 Del Mar, California Diane Grotjohn Diane.aplus@gmail.com

2. California And the Feds California Academic Performance Index Established by PSAA in 1999 Measures growth Moving Target Federal Annual Yearly Progress Established by NCLB Act in 2001 Measures progress towards a set goal All schools have same goal APLUS+ Conference October 2010 4

3. Uses of the API Ranks schools Measures progress of state intervention programs Is part of Adequate Yearly Progress Provides public information on school improvement Determines eligibility for awards Is only valid as growth measure from one year to the next (can not be compared long-range) APLUS+ Conference October 2010 5

4. Growth API For school and district: 5% of difference between API and ‘interim’ growth target of 800. –Minimum growth target for any school is 5 until school has 796 API –PSAA law says that those who do not make growth are underperforming For subgroups: –Until 2007: 80% of school or district’s growth –Now: 5% of subgroup’s difference between API and 800 –PSAA law says that lack of sufficient growth in ANY subgroup means the whole school is underperforming. APLUS+ Conference October 2010 6

5. Growth Targets for API Growth Target: Schoolwide or Subgroup Base API: 200 – 690691-795796-799800-1000 Schoolwide or Subgroup 5% difference between base API and 800 5-point gain 796 +4-pts 797 +3-pts 798 +2-pts 799 + 1-pt Maintain 800 or more APLUS+ Conference October 2010 7

6. API Target Calculation APLUS+ Conference October 2010 8 Maximum 1000 Target 800 Example School 535 Minimum 200 0 5% x (800-535) = 13 Growth Target 5% of the Distance to the Statewide Performance Target

7. Required Components of API* CAPA – California Alternate Performance Assessment CMA – California Modified Assessment CST– California Standards Test CAHSEE – California High School Exit Exam APLUS+ Conference October 2010 9 *Include when valid and reliable

8. API for Schools, Districts, and Subgroups Two APIs each year: Base and Growth Base API is used for ranking deciles.(Feb- Mar) Growth API shows changes in most recent testing (Fall) Since 2001, a new API calculation formula each year. Year to year comparisons are not valid. Can only compare growth rates, not API score District API (base and growth) since 2003 APLUS+ Conference October 2010 10

9. Example: Assessment Changes APLUS+ Conference October 2010 11

10. API Performance Level Weighting Factors APLUS+ Conference October 2010 12 Note: A Weighting Level of 200 is “assigned” to “untested” students in 8 -11 grade Math and 9 – 11 grade Science

11. 2007/2008 and 2008/2009 API Test Weights Grades 2-8 APLUS+ Conference October 2010 13 Note: Test weights are not shown as percentages and do not total 1.00. Content Area 2009–10 API Test Weights CST/CMA/CAPA in ELA, Grades 2–80.48 CST/CMA/CAPA in Mathematics, Grades 2–80.32 CST/CMA/CAPA in Science, Grades 5 and 80.20 CST in History–Social Science, Grade 80.20 Assignment of 200, CST in Mathematics, Grade 80.10

12. 2008/2009 API Test Weights Grades 9-12 APLUS+ Conference October 2010 14 Content Area 2009-10 API Test Weights CST/CAPA in ELA, Grades 9-110.30 CST/CAPA in Mathematics, Grades 9-110.20 CST in Science, Grades 9-110.22 CST/CAPA in Life Science, Grade 100.10 CST in History-Social Science, Grades 9-110.23 CAHSEE ELA, Grades 10-120.30 CAHSEE Mathematics, Grades 10-120.30 Assignment of 200, CST in Mathematics, Grades 9-110.10 Assignment of 200, CST in Science, Grades 9-110.05 Note: For CAHSEE, grades eleven and twelve are counted only if the student passed. Test weights are not shown as percentages and do not total 1.00.

13. APLUS+ Conference October 2010 15

14. APLUS+ Conference October 2010 16

15. APLUS+ Conference October 2010 17

16. APLUS+ Conference October 2010 18 2009/2010 API Overview, 9 – 12 Schools

17. “Assignment of 200” What is it? A score of 200 is assigned to every student who does not have a valid score in –CST-Math (grades 8-11 ) A test weight of 0.10 is used in the API calculation instead of 0.32 (grade 8) or 0.20 (grades 9-11) –CST-Science (grades 9-11) a test weight of 0.05 is used in the API calculation instead of 0.22 APLUS+ Conference October 2010 19

18. Math Rules Rules for Grades 8-9 CST in General Math: APLUS+ Conference October 2010 20  For grade 8, the performance level of the student record is lowered by one performance level  For grade 9, the performance level of the student record is lowered by two performance levels

19. Scale Calibration Factor Designed to “maintain consistency” in statewide average API from one reporting cycle to the next The “SCF” is calculated for each grade span Difference between statewide average Growth and Base API’s for the same year’s test data Added to school, LEA, subgroup API Does NOT preserve comparability across reporting cycles Can not accurately compare year-to-year scores 9/20/2015 21

20. Subgroups Numerically significant subgroups ALSO have Base and Growth APIs. –“Numerically significant” if either: 100 students in group 50 students in group, which is at least 15% of total student population Numerically significant subgroups all must grow 5% of the difference of the subgroups previous year’s API and 800. “Comparable Improvement” or “CI” is now included in API reports. APLUS+ Conference October 2010 22

21. APLUS+ Conference October 2010 23 Subgroup Determination

22. English Learners Who counts, and when? –If in US less than one year, doesn’t count for proficiency on AYP March 15 is cut off date –Does count in API and in participation rates for AYP –Is included in API calculations, but NOT in EL subgroup API APLUS+ Conference October 2010 24

23. Reclassified Fluent-English- Proficient (RFEP) Included in EL subgroup UNLESS –Scored Proficient or above on ELA CST for 3 years –If not marked, ETS assumes “yes” Not counted to determine if subgroup is numerically significant NOTE: Verify the accuracy of demographics with ETS – if not identified, they will assume not in subgroup APLUS+ Conference October 2010 25

24. So, Exactly, WHO counts? All students enrolled on first day of testing –With some exceptions... APLUS+ Conference October 2010 26

25. How is “Enrollment First Day of Testing” Determined? Is there a test document for the student? (See flow chart page 31) APLUS+ Conference October 2010 27

26. How is “Number Tested” Determined? Was the student “enrolled on the first day of testing”? Did the student take any portion of any test? (Flow chart p. 32) APLUS+ Conference October 2010 28

27. How is “Valid Scores” Determined? Is the student included in “number students tested”? Was the student continuously enrolled for the academic year? APLUS+ Conference October 2010 29

28. Including the CAHSEE All 10 th graders enrolled at “census” count All 11 th and 12 th grade passers count (Flow Chart p. 35) APLUS+ Conference October 2010 30

29. Inclusion/Exclusion Rules  Mobility  Completely Blank Test  Irregularity  Unmatched Score  Accommodations/Modifications  Special Testing Conditions APLUS+ Conference October 2010 31

30. Inclusion/Exclusion Rules Mobility If a student has been continuously enrolled in a school from the October CBEDS date to the testing date, the student is counted in the school API. English learners enrolled in a U.S. school for less than a year are not counted in the school or LEA API (matches AYP calculation rules). APLUS+ Conference October 2010 32

31. Inclusion/Exclusion Rules Completely Blank Test If a student record shows no scores or items attempted on any part of the CST, and CAPA used in API, the entire STAR Program student record is not included in API. Exceptions: If a student record shows “Tested but Marked No Answers” (Code Z) for any content area, the content area is included and assigned a weight of 200 APLUS+ Conference October 2010 33

32. Inclusion/Exclusion Rules Completely Blank Test Exceptions (continued): CAHSEE grade 10 student census (February or March) record showing “Blank/ Not Attempted” for one or both content areas is included and assigned a weight of 200 for content area(s). Blank records for grades 11 and 12 are excluded. APLUS+ Conference October 2010 34

33. Inclusion/Exclusion Rules Accommodations CST or CAHSEE: Accommodations do not effect score APLUS+ Conference October 2010 35 Note: This rule is the same for AYP calculations.

34. Inclusion/Exclusion Rules Modifications for API CST or CAHSEE: The score is included for the content area and assigned a weight of 200. The “ Matrix of Test Variations, Accommodations, and Modifications for Administration of California Statewide Assessments ” can be found at http://www.cde.ca.gov/ta/tg/sr. APLUS+ Conference October 2010 36

35. Inclusion/Exclusion Rules Modifications for AYP CST or CAHSEE: Counted in AYP participation rate as “not tested Not counted in AYP percent proficient APLUS+ Conference October 2010 37

36. Statewide Ranking Schools ranked 1 to 10; 10 is best. Half of all schools will always be underperforming. Always. Greater API growth is needed to move out of decile1 or 2 than deciles 5, 6, 7. If you stand still, others will pass you by. APLUS+ Conference October 2010 38

37. API Ranks Ranks are established by deciles. Base API is used to establish ranks A school’s rank may, or may not, improve if API improves depending on what other schools did. LEAs and ASAM schools receive API scores, but do not receive ranks Small schools (<99 valid scores) do not receive similar school ranks APLUS+ Conference October 2010 39

38. APLUS+ Conference October 2010 40

39. “School Type” for API Ranks are calculated separately by school type Schools are compared by “type” 3 “types”: –Elementary, Middle, and High –Based on lowest and highest grade in which a student was reported at CBEDs APLUS+ Conference October 2010 41

40. My school doesn’t “fit” a “type” School type is based on enrollment in “core grade spans” –Elementary: K-5 –Middle: 7 – 8 –High: 9 - 12 Some (very few) schools are assigned “type” based on name or characteristics If Base API school type is different from Growth API school type, districts are given opportunity to change APLUS+ Conference October 2010 42

41. Similar School Rank Variables APLUS+ Conference October 2010 43

42. Similar School Ranks Determine school type: Elementary, Middle, High Calculate School Characteristics Index (SCI) Sort schools by SCI. Find 50 schools above and 50 below target school. Using identified similar schools, sort schools by API. Identify deciles. APLUS+ Conference October 2010 44

43. AYP APLUS+ Conference October 2010 45

44. And for AYP…. Four requirements: –Participation Rates –Percent Proficient –Graduation Rate –API as “additional indicator” APLUS+ Conference October 2010 46

45. Schools are “underperforming” if School or any subgroup misses any target If miss same target for 2 years, go into Program Improvement (Unless not a Title 1 school) Get out of PI if meet all targets for 2 years Number of schools in PI in California is growing each year APLUS+ Conference October 2010 47

46. AYP Targets for 2010 Percent Proficient for K-8 –ELA: 56.8 –Math: 58.0 Percent Proficient for High Schools –ELA: 55.6 –Math: 54.8 Minimum API of 680 –Or growth of at least 1 point Graduation Rate –90% or –Fixed growth rate or –Variable growth rate APLUS+ Conference October 2010 48

47. AYP Proficiency Targets Over Time APLUS+ Conference October 2010 49

48. Four-Year Graduation Rate Formula for ESEA Graduation Rate for 2010 Number of Graduates (2008–09) divided by Number of Graduates (2008–09) + Grade 9 Dropouts (2005–06) + Grade 10 Dropouts (2006–07) + Grade 11 Dropouts (2007–08) + Grade 12 Dropouts (2008–09) APLUS+ Conference October 2010 50

49. APLUS+ Conference October 2010 51 Assessments Used in API/AYP CSTCMA CAP A CAHSE E Grade level ELA Writing Math General Math Algebra 1, Geomet ry, Algebra 2, Integrat ed Math 1, 2, or 3, Summat ive Math History- Social Science Science Biology, Chemist ry, Physics, Earth Science, Integrat ed Science 1,2,3, or 4 English/ Langua ge Arts Math Science ELA, Math See Note 2a See Notes 2b-2d See Notes 3a- 3b See Note 4a See Note 4b See Notes See Notes #1 2X, I, Y CSTCMACAPA CAHS EE Note 2a Notes 2b-2d Notes 3a- 3b Note 4a Note 4b See Notes Added 2009 Notes 1 a-d 2X, I, Y SPED, I, Y 3X, I, Y SPED, I, Y 3X, I, Y 4 SPED, I, Y 4X, I, Y 5 X, I SPED, I, Y SPED, I 5X, I, Y 6 I SPED, I, Y 6X, I, Y 7 I SPED, I, Y 7X, I, Y 8 X, I-1, Y or X, I, Y X (US), IX, I SPED, I, Y SPED, I SPED, I, Y SPED, I 8X, I, Y X, I-1, Y or X, I, Y 9X, I X, I-2 or X, I X (Wld), I I SPED, I 9X, I X, I-2 or X, I 10X, I I X(Wld, US), IX, I I SPED, I, Y SPED, IX, I, Y 10X, I 11X, I I XN(W ld), I I SPED, I X, I 11X, I 12 X, I 12

50. Thank you! APLUS+ Conference October 2010 52