1. VAAP Regional Scoring Pilot 2007 – 2008 Roundtable VATD Fall 2008 Dr. Sharon Siler, Virginia Department of Education Deb Anderson, Fauquier County Public Schools Lenore Callahan, Fairfax County Public Schools Jennifer Jones, Stafford County Public Schools Mary Wills, Fauquier County Public Schools

2. Objectives Highlight the events of the 2007 – 2008 Regional VAAP Scoring Pilot Discuss the rationale behind having a VAAP Regional Scoring Event Share the leadership efforts and supports in organizing a VAAP Regional Scoring Event Outline the PROs & GROWs of the VAAP Regional Scoring Pilot Share the PROs & GROWs of the VAAP Regional Scoring Pilot Audit

3. Regional Scoring Pilot 2007 – 2008 VAAP Background: Hosted by Fauquier County Public Schools May 5 – 9, 2008 Seven Participating Divisions

4. Participating Divisions 2007 – 2008 VAAP Regional Scoring Pilot Fairfax County Schools Fauquier County Schools Gloucester County Schools Manassas City Schools Orange County Schools Rappahannock County Schools Stafford County Schools

5. Regional Scoring Pilot 2007 – 2008 VAAP 386 COEs 25 Scorers 5 Score Entry Staff 2 VDOE Staff 1 Fauquier Hostess

6. Virginia Department of Education 2007 – 2008 VAAP Regional Scoring Pilot Provided: Onsite oversight for Scoring & Score Entry Scoring & Score Entry training materials Scoring Qualification Sets Curriculum Frameworks VAAP Worksheets Coffee Supplies

7. What was VDOE’s rationale for conducting a VAAP Regional Scoring Pilot? To investigate the outcomes of a collaborative scoring effort regarding: consistent scoring practices across divisions potential savings of time and resources by school divisions increase local capacity to develop successful VAAP collections of evidence

8. Pearson 2007 – 2008 VAAP Regional Scoring Pilot Provided: Onsite Technical Assistance for Score Entry Phone number for planning conference calls

9. Fauquier County Schools (Host) 2007 – 2008 VAAP Regional Scoring Pilot Provided: Warm & Inviting Atmosphere Scoring & Score Entry Facilities Internet Access Storage Area Audio-visual Equipment/ Media (computers, fax, office supplies, etc.) Community Knowledge & Logistics (restaurants, local businesses & coordinated snacks)

10. Hosting Rationale 2007 – 2008 VAAP Regional Scoring Pilot We saw the need for Regional Scoring and wanted to be part of its development We needed more scorers so we could pre- score and give more help to the teachers developing the COEs We were looking for consistency in scoring We had space and a good central location to offer And I like to volunteer

11. Participating Divisions 2007 – 2008 VAAP Regional Scoring Pilot Provided: Scorers Score Entry/Process Staff Collections of Evidence (COEs) Office supplies Snacks to Share Transportation of COEs to Fauquier facility

12. Participating Rationale 2007 – 2008 VAAP Regional Scoring Pilot Expert guidance from VDOE Freed from other obligations to focus on scoring On-site Technical assistance from Pearson Helping hands from other divisions Networking opportunities Learned from other divisions New ways to demonstrate mastery Building scoring consensus

13. Initial Support 2007-2008 VAAP Regional Scoring Pilot Planning (Pre – Event Activities) 2 Planning Conference Calls facilitated by VDOE Student Data Uploads Student Master List Assignment of Scorers to 2 – person teams Organizing (Data Collection Method) Scorer/Score Entry Staff Questionnaires Post Event Conference Call with Test Administrators from Participating Division Audit Results Comparisons

14. Reflection on PROs 2007 – 2008 VAAP Regional Scoring Pilot Expert guidance from VDOE Freed from other obligations to focus on scoring On-site Technical assistance from Pearson Helping hands from other divisions Networking opportunities Learned from other divisions New ways to demonstrate mastery Building scoring consensus

15. Reflection on GROWs 2007 – 2008 VAAP Regional Scoring Pilot Participating Divisions need to conduct more pre-scoring/monitoring of COEs before they get to the scoring event Participating Divisions should confirm SDUs include all students who have a binder submitted

16. Reflection: PROs & GROWs Gleaned from the Questionnaires 2007-2008 VAAP Regional Scoring Pilot PROs  Onsite Training  Number of Scorers  Process Sheet to Track COEs  2 – Person Scoring Teams  Working with Scorers from other Divisions  Qualifying Sets  Available Technical Assistance  Facility GROWs  Use of same Anchor Sets  Number of Score Entry Staff  Need for more space in scoring room  Technology used to view submitted media in same room as data entry

17. Future Events VAAP Regional Scoring Conduct 2 VAAP Regional Scoring Events in 2009 Continue VAAP Regional Scoring in Fauquier County Recruit other Host Division(s) Recruit Participating Divisions

18. Questions ?