1. PARCC National Title I Conference February 2, 2014 Doug Sovde, Director Content and Instructional Supports PARCC, Inc. 1

2. Disseminate actionable advice and information to support implementation of PARCC assessments and field test administration Provide a deeper understanding of the PARCC design and supports Engage with PARCC items, first hand Session Objectives 2

3. 3 PARCC Overview

4. Where We Started, Where We Are and Next Steps 4 SEPTEMBER States launch PARCC DECEMBER Governing Board meets SUMMER Model Content Frameworks Released OCTOBER College and Career Ready Determination Policy Adopted AUGUST Item Prototypes Released APRIL Test Blueprints released SUMMER Educator Leader Cadres Launched SUMMER PARCC becomes independent nonprofit AUGUST Sample Items Released We are here ! WINTER/SPRING Field Testing/Releas e of Practice Test SPRING First Administration of New Tests SUMMER Establishment of Cut Scores FALL Release of Diagnostic and Formative Assessments 2010 2011 2012 2013 2014 2015 FALL Use of Cut Scores for IHE Placement 2016 Next year

5. The PARCC Consortium 18 states and the District of Columbia 15 million students in tested grades Aligned to the Common Core State Standards Developed by educators in nearly two dozen states 2013-14 field testing 2014-15 roll out

6. PARCC’s Priorities 1.Determine whether students are college and career ready or on track 2.Measure the full range of the CCSS and full performance continuum 3.Support educators in the classroom with timely data 4.Make better use of technology in assessments 5.Advance accountability at all levels 6.Provide comparable data from school-to-school and state-to-state 7.Be affordable and sustainable

7. Assessment Design ELA/Literacy and Mathematics, Grades 3–11 Beginning of School Year End of School Year Diagnostic Assessment Mid-Year Assessment Performance- Based Assessment End-of-Year Assessment Speaking and Listening Assessment OptionalRequired Key: Flexible administration

8. Content Focus of PARCC Assessments 8 ELA/Literacy Read and comprehend literary and informational texts independently Write effectively to sources Math Demonstrate conceptual understanding and fluency Reason mathematically Model real-world problems

9. 9 PARCC Field Test

10. The field test will generate the data needed to allow PARCC to ensure item quality and to select items/build forms for operational assessments in 2014-2015 PARCC will use the field test data to evaluate: – Accessibility/Fairness: Are items accessible to SWDs and ELs? – Comparability : Can computer-and paper-based tests, desktop and tablet-based tests be put on the same reporting scale? – Construct validity: Do the assessments measure the concepts they were designed to measure? – International benchmarking: What are the best ways to link PARCC assessments with national and international assessments? – Quality of test administration: Are the manuals and directions clear? – Various psychometric studies: What are the best ways to combine PBA and EOY results? Is vertical scaling feasible? The Purpose of the Field Test: Ensuring Test Quality 10

11. “Testing the Test” 14 States and DC – AR, AZ, CO, DC, IL, LA, MA, MD, MS, NJ, NM, NY, OH, RI, TN Approximately 1.2 million students PARCC-Wide 10,000 items covering 21 different tests – ELA, grades 3-11 – Math grades 3-8 and high school end-of-course (Algebra, Geometry, and Algebra II, Integrated Math I, II, III) Field Test Window – Performance-based component: March 24-April 11 – End-of-Year component: May 6-June 6 Field Test: Scope 11

12. Most students participating in the PARCC Field Test will take one component (Performance Based Assessment or End of Year) in one content area (ELA or mathematics). A small percentage of students will take both components (Performance Based Assessment and End of Year) in one content area only (ELA or mathematics). Some students will take the field test on a computer, while others will take it on paper. Field Test Administration: Participating Schools 12

13. 13 PARCC Field Test Preparations

14. Tutorial and Sample Items (January 17) – Familiarize students with how to navigate in the TestNav 8 computer- based environment (e.g., advancing, going back, flagging and reviewing items, calculators, tool bar, accessibility features) – Familiarize students with new item types (PCRs, EBSRs, Type II, Type III) and item functionalities /tools (drag and drop, hot spot, multiple select, text extraction, equation editor, rulers, protractors, calculators, and accessibility features). Practice Tests – The practice test will enable students and teachers who are not participating in the field test to become familiar with the PARCC assessments and to practice with the different item types and computer-based interactions that students will encounter with PARCC items. Preparing Students 14

15. System Check Tool (Available Now)Available Now – Audience: PARCC States, LEA’s, Schools, and Technology Staff – Verifies whether the school’s devices meet the requirements for running TestNav 8 – Evaluates capacity of school’s bandwidth for testing directly over the Internet or through Proctor Caching Full-Scale Infrastructure Trial (January 17) – Audience: Computer-based PARCC Field Test Participants – Designed to be a ”dress rehearsal” exercise where LEAs will simulate their full testing environment before the operational test administration – Performed by the school using a full size model test form and mocked up student information to simulate a full testing load with the devices and network configuration at the school. TestNav 8 Readiness Tools and Materials 15

16. Proctor Caching Software and Proctor Caching Users’ Guide (Available Now)Available Now – Audience: Any PARCC States, LEA’s, Schools, and Technology Staff – Proctor Caching is a a low bandwidth test administration solution available to all PARCC schools as part of the Pearson TestNav 8 delivery platform. – Caching places secure test content on a designated administrative computers that then serves test forms to student devices through the local school network. – PARCC encourages broad use of Proctor Caching as a strategy to manage against possible Internet connection disruptions during testing. Caching is also recommended for student forms requiring accommodations. TestNav 8 Readiness Tools and Materials 16

17. Compatible Assistive Technology List (Available Now) – Audience: Any PARCC States, LEA’s, Schools, and Technology Staff – Additional assistive technologies may be needed for students requiring accommodations. PARCC has published a list of Assistive Technologies that have no known compatibility conflicts with the TestNav 8 test delivery system. – The list will be continually updated as ongoing assistive technology usability research is conducted and can be found here: www.pearsononlinetesting.com/AssistiveTechnologywww.pearsononlinetesting.com/AssistiveTechnology or www.pearsononlinetesting.com/AT TestNav 8 Readiness Tools and Materials 17

18. State Teams: Building local capacity to sustain implementation 24 members per state totaling almost 600 across PARCC States – Members include: K-16 educators and district-level administrators – Provided with training and tools to understand, support and own the implementation of the CCSS and PARCC assessments Models of State Engagement: – New Mexico: Classroom and district level ELCs have presented at over 75 functions, events or trainings to date. – Louisiana: Expanded ELC teams locally by training and placing PARCC and CCSS advocates in every state school—bringing the number of ELC members to almost 2,000 across the state. Building Collaboration and Partnerships – Item reviewer partnership with NEA and AFT – iTunes U Common Core Resources Project with ELC members Professional Development and Supports for Teachers: Educator Leader Cadres

19. Implementation Resources for Teachers Model content frameworks – www.parcconline.org/parcc-model-content-frameworks www.parcconline.org/parcc-model-content-frameworks Blueprints – http://www.parcconline.org/assessment-blueprints-test-specs http://www.parcconline.org/assessment-blueprints-test-specs Sample items for every tested subject and grade – http://practice.parcc.testnav.com/# http://practice.parcc.testnav.com/# Educator Leaders Cadres – Public ELC portal for educator resources! o http://parcc.nms.org/ http://parcc.nms.org/ Practice Test – Spring 2014, PARCC practice test will be available to students, teachers and parents via PARCConline.org 19

20. The PARCC consortium’s Data Privacy and Security Policy is designed to ensure that PARCC and any PARCC contractors: Only have access to personally identifiable student information for specific purposes authorized by states needed to carry out assessment programs Implement specific stringent policies and procedures that protect the security of data Limit access to personally identifiable student information to only those contractors who need it for specific purposes authorized by states Ensure compliance with federal privacy laws, including FERPA 20 Data Privacy and Security Policy

21. Establishes the purposes for which states would disclose PII to PARCC or PARCC contractors Establishes physical, administrative, and technical safeguards for management and control of risks– and accountability for any breaches of security Sets basic privacy protections and limits on access to PII that states provide to PARCC or PARCC contractors, such as access rules and electronic data encryption requirements Sets guidelines for the enforcement of this policy by PARCC and PARCC states, including disciplinary actions 21 Major Provisions of Data Privacy & Security Policy

22. PARCC Accessibility Features And Accommodations Manual – Guidance for Districts and Decision-Making Teams to Ensure that PARCC Mid-Year, Performance-Based, and End-of-Year Assessments Produce Valid Results for All Students PARCC Translation Policy: – PARCC will develop translations of its mathematics assessments in Spanish and other languages for states requesting the translations – Use of the translated assessments will be a state decision. The additional costs associated with translating and administering assessments in languages other than English will be shared by the states that use them Accessibility and Accommodations 22

23. 23 Supporting All Students

24. All students will have equitable opportunities to access and respond to PARCC assessment items and tasks. Accessibility 24

25. Provide clear guidelines for writing unbiased items Utilize Equity Technical Working Group expertise Use principals of Universal Design Conduct bias and sensitivity reviews and statistical procedures Develop common test accommodation and participation policies for SWDs and ELLs Use technology Conduct research Strategies for Increasing Student Access

26. Timeline for Increasing Access Strategies Summer 2012Bias and Sensitivity Guidelines OngoingBias and Sensitivity Reviews Summer 2012Accessibility Guidelines Winter 2013Common Definition ELL Spring 2013Common Participation Policies (SWD/ELL) Spring 2013Common Accommodation Policies (SWD/ELL) Summer 2014Statistical Reviews Spring 2013, 2014Research

27. Committees on Accessibility Operational Working Group Technical Working Group – There are three sub-groups: (1)Students with disabilities (2)English learners (3)Equity 27

28. Accessibility, Accommodations, & Fairness Operational Working Group Operational Working Group members represent the following states: * Co-chairs of the AAF OWG 28 Operational Working Group Arizona Colorado* Florida Illinois Indiana Louisiana Maryland* Massachusetts New Jersey New Mexico New York Ohio Oklahoma Rhode Island Tennessee

29. Accessibility, Accommodations, & Fairness Students with Disabilities Sub-TWG Subgroup MembersAffiliation Dave EdyburnUniversity of Wisconsin-Milwaukee Claudia FlowersUniversity of North Carolina-Charlotte Dianne PicheLeadership Conference on Civil Rights Alba OrtizThe University of Texas at Austin Diane SpenceRegion 4 Education Service Center, Braille Services Martha ThurlowNational Center on Educational Outcomes Daniel Wiener* Massachusetts Department of Elementary and Secondary Education *Chair of the AAF TWG and liaison to the AAF OWG

30. Accessibility, Accommodations, & Fairness English Language Learner Sub-TWG Subgroup MembersAffiliation Diane AugustCenter for Applied Linguistics H. Gary CookUniversity of Wisconsin-Madison Kenji HakutaStanford University Alba OrtizThe University of Texas at Austin Charlene RiveraGeorge Washington University Daniel Wiener* Massachusetts Department of Elementary and Secondary Education *Chair of the AAF TWG and liaison to the AAF OWG 30

31. Accessibility, Accommodations, & Fairness Equity Sub-TWG Subgroup MembersAffiliation Amy EpsteinLeadership Public Schools Keena ArbuthnotLouisiana State University Edward BossoGallaudet University Yvette JacksonNational Urban Alliance for Effective Education Carol D. LeeNorthwestern University Teresa L. McCartyArizona State University Daniel Wiener* Massachusetts Department of Elementary and Secondary Education Dianne PicheLeadership Conference on Civil Rights *Chair of the AAF TWG and liaison to the AAF OWG 31

32. Accessibility as Part of the Development Process Accessibility guidelines – Design review and feedback – Test blueprint development – Technology development and selection – Passage and media review committee involvement 32

33. Accessibility as Part of the Development Process Item review & bias and sensitivity committee involvement – Review for bias and sensitivity – State leads with diverse backgrounds 33

34. Accessibility as Part of the Development Process Cognitive labs & item development research – Testing efficacy of assessment items with accommodations in pilot and field testing – Including sufficient number of students with identified needs – Data review committee involvement 34

35. Examples include: Highlighting Customized colors Graphic organizers or representations Home language supports/tools Captions for audio Braille (tactile/refreshable) Signing supports (ASL) Assistive technology Embedded Supports Being Discussed

36. 36 PARCC Sample Items http://practice.parcc.testnav.com/#

37. 37 ELA/Literacy, Grades 3-5

38. 38 Mathematics, Grades 6-8

39. Questions and Discussion 39

40. Learn More About & Follow PARCC Partnership for Assessment of Readiness for College and Careers www.parcconline.org On Twitter: @PARCCPlace #askPARCC & #PARCCELC ELC Portal: http://parcc.nms.org

41. Summative Assessments – Performance-based (PBA) component – End-of Year (EOY) component – Speaking and Listening component Optional Assessments – Diagnostic – Mid-year assessment (MYA) 41 Overall Design of the PARCC Assessment System

42. Summative Assessment Components 42 Performance- Based Assessment End-of-Year Assessment  After 90 percent of the school year  Short-answer items  ELA/literacy: Reading comprehension  Math: Concepts, skills, and fluency (grades 3-6)  After 75 percent of the school year  Short and extended tasks  ELA/literacy: Writing effectively when analyzing sources  Math: Solving multistep problems with an emphasis on the mathematical standards for practice: reasoning and modeling Beginning of School Year End of School Year Results of both the PBA and EOY will be combined to generate a student’s overall score (performance level)

43. Optional Assessments 43 Diagnostic Assessment Mid-Year Assessment Flexible administration  Design will be similar to required Performance-Based Assessment  Could serve as a benchmark or interim assessment  Computer-based  Target grades 2-8 in reading, writing, and mathematics  Determine students’ learning needs in order to tailor instruction Beginning of School Year End of School Year

44. PARCC Assessment System ELA/Literacy and Mathematics, Grades 3–11 44 Beginning of School Year End of School Year Diagnostic Assessment Mid-Year Assessment Performance- Based Assessment End-of-Year Assessment Speaking and Listening Assessment OptionalRequired Key: Flexible administration

45. At each grade level include three tasks – Research Simulation Task – Literature Analysis Task – Narrative Writing Task Each task will require students to – Read one or more passages, one of which may be a multi- media stimulus (e.g. video) – Answer short answer reading comprehension questions, and – Write an extended response to a prompt that requires the student to draw evidence from the passage(s) to support their response 45 ELA/Literacy: Performance-Based Assessments

46. Hardware – 1 GHz or faster processor – 1 GB of RAM or greater memory – 9.5 inch (10 inch class) or larger screen – 1024 X 768 of better screen resolution Operating System – Windows 7 – MAC 10.7 – Linux (Ubuntu 11.10, Fedora16) – Chrome OS – Apple iOS – Android 4.0 Networking – Wired or wireless Internet connection Devices – Desktops, laptops, netbooks, thin client, and tablets that meet the hardware, operating system, and networking specificaitons Minimum Guidelines for Hardware Purchases 46