1. Classroom Diagnostic Tools Pennsylvania Department of Education
PAIUCC Meeting
Classroom Diagnostic Tools
and
Keystone Exams
September 17, 2010
Pennsylvania Department of Education

2. Agenda Introductions Keystone Exams Overview Keystone Exams Fall 2010
Keystone Exams Spring 2011
Keystone Exams Key Dates
Keystone Policy Impacts
Classroom Diagnostic Tool (CDT) Overview
CDT Field Test
CDT Key Dates
CDT Reporting
Fall 2010 Field Test -- Administrative Key Dates
Data Management
Questions

3. Keystone Exams Overview
The Keystone Exams are end-of-course assessments designed to assess proficiency in the subject areas of Algebra I, Algebra II, Geometry, Literature, English Composition, Biology, Chemistry, U.S. History, World History, and Civics and Government.
One component of Pennsylvania’s high school graduation requirements beginning for the graduating class of
Taken as an end-of-course exam near the end of course completion that counts for at least one-third of the final course grade
PDE recommends administering the English Composition Keystone Exam at the end of English 9 and Literature at the end of English 10
Available to students either online or paper-pencil
Comprised of two (2) modules
Multiple-Choice (MC) and Constructed-Response (CR) items

4. Keystone Exams Fall 2010
Field test of Algebra I, Biology, and Literature
Available to mostly students in high school, but may include middle school students
Online and/or paper-pencil assessment comprised of two modules
Multiple-Choice (MC) and Constructed-Response (CR) items
Approximately 2-2 ½ hours for each exam, 1-1 ¼ hours per module
Student should be assigned to an assessment based on course enrollment in the school year
Field test results will be provided for participating districts

5. Keystone Exams Spring 2011
First operational administrations of Algebra 1, Biology, and Literature
Field test administrations of Algebra 2, Geometry, and English Composition
Testing window will be beginning of May (exact dates not yet finalized)
Students nearing completion of a course are eligible to take the course-specific Keystone Exam

6. Keystone Exams Spring 2011 Online and paper-pencil formats available
Paper/pencil testing materials will arrive in two shipments
Administrative materials arrive four weeks prior to the window
Secure materials arrive two weeks prior to the window
Paper-pencil testing materials are returned after each subject is complete
Preliminary results provided around the end of May
Final results (with performance levels) provided later in summer (Algebra 1, Biology, and Literature only)

7. Keystone Exams Key Dates Field Test and Operational Assessments
Algebra I, Biology, Literature
November 1-19, 2010
May 2011
Algebra II, Geometry, English Composition
Winter 2011
US History
Fall 2012
May 2013
Chemistry, Civics & Govt., World History
May 2015
TBD

8. Graduation Policy
Under the new regulation and beginning with the class of 2015, students can meet graduation requirements through any of the following options determined by the district:

9. Graduation Policy 2 Phases
Students in the graduating classes of 2015 and 2016 must demonstrate proficiency in:
English Composition
Literature
Algebra I, and
Biology

10. Phase 2- Class of 2017 and beyond
Students must demonstrate proficiency in six of ten content areas:
Both English Composition and Literature;
Two of three Mathematics (Algebra I, Algebra II, or Geometry);
One of two Sciences (Biology or Chemistry); and
One of three Social Studies (American History, Civics and Government or World History).

11. Chapter 4 Advisory Committees
Three advisory committees are specified in the regulation:
Performance Level Advisory Committee
Local Assessment Advisory Committee
State Assessment Advisory Committee

12. District Choice
Keystone Exams will count for at least 1/3 of the final course grade; or NEW:
Keystones used as a local assessment and students must score proficient or advanced.
Locally designed and independently validated assessments

13. Pass Rigorous National Assessments
District Choice
Pass Rigorous National Assessments
National assessments are the Advanced Placement (AP) Exams and the International Baccalaureate (IB) Exams
PDE will release policy guidance regarding the minimum score on each that is needed to satisfy graduation requirements

14. Project Based Alternative
A student who does not score “proficient” on a Keystone Exam after two attempts will be eligible to complete a project-based assessment
The regulation includes a waiver provision, which can be used by the Secretary of Education to exempt an individual student from the graduation requirements

15. Project–Based Assessment
Projects will be:
aligned with the Keystone Exam modules
developed by the department
administered by school staff
scored by regional panels of educators
developed so that points will be added to a student’s highest Keystone score if his/her performance is judged “satisfactory.”

16. Eligibility for Projects
Students will qualify for projects if he/she:
has taken the course.
was unsuccessful after two attempts with the Keystone exam.
has met the district’s attendance requirements for the course.
has participated in supplemental instructional services.
Any student who does not score proficient on a Keystone Exam after two attempts will be eligible to complete a project-based assessment, provided the student has taken the course and met local attendance and supplemental instruction requirements.

17. CDT Overview Available to students in grades 6 through high school
The Classroom Diagnostic Tools provide a diagnosis of students’ strengths and weaknesses to guide instruction and/or remediation.
Available to students in grades 6 through high school
Online assessments delivered in a Computer Adaptive Test (CAT) format
Multiple-choice items
Multiple assessments a year
Real-time reporting
Reports dynamically linked to curriculum resources in SAS

18. CDT Fall 2010
Field Test Event for Science and Reading
Available to students in grades 4 through high school
Assesses content in Science and Reading grades 3-8, Biology, Chemistry, Literature
Multiple-Choice (MC) items
Single assessment – approximately 1 class period (45-60 minutes)
Student should be assigned to an assessment based on course/grade enrollment in the school year
Field test results will be provided for participating districts
Operational Mathematics Available to Schools –
October 18, 2010

19. Field Test and Operational Assessments
CDT Key Dates
Field Test and Operational Assessments
Field Test
Operational
Mathematics
April 26-May 28, 2010
October 18, 2010
Literature
October 4-29, 2010
Winter 2010/2011
Science
Writing/Composition
May 2011
Fall 2011
Social Studies
Fall 2012
Winter 2012/2013
Highlighted math operational to emphasize.

20. CDT Reporting
Reporting for the CDT will be available on DRC’s eDirect system
Results will be linked to Materials and Resources on SAS
Three types of reports will be provided
Group Diagnostic Map
Student Diagnostic Map
Learning Progression Map

21. Group Diagnostic Map – Algebra I
Point out the following:
Tabs along top for navigation
Modules
Selection of a student highlights in grid
Selection of group brings up links to SAS
Export to CSV button

22. Group Diagnostic Map – Mathematics
Zoomed In Zoomed Out
Point out the following:
Default view when map opens is zoomed to where students are on the scale
Can zoom out to show full scale using the bar along left side of map

23. Group Diagnostic Map Single Diagnostic Category
Can point out:
Selection of one category shows scores for last three administrations of the CDT for the group.
Assessment three is always most recent test event

24. Student Diagnostic Map

25. Learning Progression Map
Dots represent eligible content within a grade

26. Administrative Key Dates
Fall 2010 Field Tests --
Administrative Key Dates
Key Dates
Description
Date Available
CDT
Keystone
PA Online Assessment Software
August 23
PA Online Assessment Test Tutorials
September 21
October 4
PA eDIRECT Test Setup System
September 13
PA eDIRECT District Student and Teacher file uploads available
CDT User Guide and Directions for Administration (electronically)
September 8
CDT User Guide and Directions for Administration (hardcopy in districts and schools)
September 20
Keystone Handbook, User Guide, and Directions for Administration (electronically)
Keystone Handbook, User Guide, and Directions for Administration (hardcopy in districts and schools)
October 18

27. Data Management
PIMS data was uploaded to DRC’s test setup system (eDIRECT)
Student-level data
Teacher-level data (not required for field test events)
School/district personnel will use eDIRECT to set up and manage all online testing

28. Data Management
For fall 2010, district personnel will be able to upload student and teacher data directly to eDIRECT
Any student data updated or uploaded in eDIRECT must also be updated or uploaded in PIMS
PIMS data and data uploaded into eDIRECT will be used to generate student Precode Labels (paper-pencil Keystone Exams)

29. DRC Pennsylvania Customer Service Team
Contact Information
Richard Maraschiello
Phone:
DRC Pennsylvania Customer Service Team
Phone:
Fax:

30. Questions?