1. Questions to: Kristen Lewald, Ed.D. kristen_lewald@iu13.org PVAAS Statewide Core Team PVAAS Update to PAIU Curriculum Coordinators December 2010

2. Final Numbers 2,400+ Participants! 350+ Districts and Charters!

3. So…where are we now?

4. PVAAS Webinars – Archived & Available! PVAAS webinars that took place in August and September 2010 are still available for viewing! 1. Go to http://elluminate.iu13.org click on Recordingshttp://elluminate.iu13.org 2. Click on the month the webinar was originally held using the calendar

5. Ideas for Follow-up to Fall Sessions with Districts Faculty Rollout USING the projections  Ex. Are the right students getting interventions?  Ex. Scheduling current 8 th graders  Use grade 7 to 8 projections; more reliable at predicting future performance than most recent PSSA High Growth schools forums  By grades, subjects  Based on Multiple years quintiles document Need support for follow-up with local districts?

6. SY2009-2010 Scatterplots

7. Single-Year High Growth & Achievement Quintiles

8. Single Year of Quintile 5 Growth and/or Quintile 5 Achievement Gain/GrowthAchievement Include: 5 in both growth & achievement School A55 Include: 5 in growth but not achievement School B51, 2, 3 or 4 Include: 5 in achievement but not growth School C 5 NOT included: Does not have 5 in growth nor in achievement School D1, 2, 3 or 4

9. Multiple Years (2 or 3 yrs) of Quintile 5 for Growth

10. Consecutive years of Quintile 5 Growth Results SY09-10SY08-09SY07-08 Include/ last 2 consecutive years School A55 Include/ last 3 consecutive years School B555 NOT included, 2/3 non-consecutive years School C 55 NOT included, 2/3 non-consecutive years School D5 5

11. Currently Enrolled Submission: Window 1 & 2 100+ Districts participated in the first and/or second submission window What this does for them? Future Enrollment Deadline January 7, 2011 Target 2-3 districts in your region to encourage their use of this FREE, OPTIONAL service Those with the highest mobility will benefit the most All middle schools and all high schools benefit

12. Currently Enrolled via Projection Summaries How can districts use this report?

13. Currently Enrolled via Student Search New feature on Student Search to include Currently Enrolled:

14. Projection Summaries: Projections to Advanced NEW!!!!!

15. Graduation Rate now in PVAAS!

17. Getting Results Worksheet PDFs Now available in the PVAAS “Reports” menu!

18. MISSING DATA MEASUREMENT ERROR Issues with SIMPLE, TRANSPARENT comparisons of PSSA scores at the District, School, Student levels

19. The issue of missing data is a significant issue for districts/school, meaning students who do not have a PSSA score for 2 consecutive years. They missed a test. A simple comparison of current and prior scores could only occur for students who have those 2 test scores. Other students would not be included from current/prior year analyses, meaning many students would not be included which would impact the results. Think of a district and the impact of this on their growth measures. Simple methods exclude these students who are mobile/transient as they have missing test scores. They have a history of what is called fractured records. It really impacts subgroups too as they have a history of fractured records like the ELL subgroup for example. PVAAS is able to address this issue of missing data as it is a longitudinal analysis that uses all available prior data on students.

20. Issues with SIMPLE, TRANSPARENT comparisons of PSSA scores There is too much measurement error on any one given test score or a pair of test scores. Using a simple difference of 2 scores, or 2 sets of scores, creates bias in the measures. Measurement error is a type of "noise". It is a noise around a value that is trying to measure some other value. For instance, when we have a test score for a student, it is trying to measure the true knowledge of that student in a particular subject/grade. However, there is measurement error or noise in that test score. This is a normal thing in all assessments; some have more "noise" than others. For example, teacher made tests…VERY noisy!

21. This issue of error/noise can be seen on a student’s PSSA report that goes home to mom and dad. See the example below and on next slide- this is a student’s actual recent PSSA report from SY09-10. His math scaled score on the PSSA was a 1720-- HOWEVER, read the statement below the number line….. Almost a 200 point range!!! SO what is his true understanding of mathematics...??? Issues with SIMPLE, TRANSPARENT comparisons of PSSA scores

22. Individual Student Report

23. This is a normal issue for assessment, but a reality that simple, transparent models like the comparison of 2 sets of scores does not address. Think why we all took the SAT more than one time!!! To have measurement error hopefully work to our advantage and get a higher score the 2nd time we took it or the 3rd time……. The PVAAS methodology uses all available test scores on each student to mitigate the effects of measurement error on the analyses; basically to mitigate these kinds of issues. Issues with SIMPLE, TRANSPARENT comparisons of PSSA scores

24. Handout for YOU to give to YOUR Districts Summary handout for you to give to your districts from these updates  Superintendents  Asst Supt/Directors of C & I  Directors of Special Ed  Principals  Teacher Leaders Will send email with document enclosed Will also post on Sharepoint

25. pdepvaas@iu13.org 717-606-1911 Questions? Unmet Needs?