1. Classroom Diagnostic Tools CDT UPDATES for PAIUCC September 17, 2015 Dan Richards Dr. Carrie Soliday Brian Stamford Rich Maraschiello 1* Pedro A. Rivera, Secretary of Education Tom Wolf, Governor

2. Classroom Diagnostic Tools 2* 2015-16 CDT Lead Team (Pending Contract Approvals) Dr. Bobbie Pfingstler - Consultant Dan Richards - IU14 Dr. Carrie Soliday - IU12 Brian Stamford - IU3

3. Classroom Diagnostic Tools Updated Helpful Documents on eDIRECT 1. Go to https://pa.drcedirect.com 2. Go to General Information. 3. Click on Documents. 4. Under Administration, select the most current year for Classroom Diagnostic Tools. 5. Under Document Type, click on All. 6. Click Show Documents.

4. Classroom Diagnostic Tools New Assessment Names Current Assessment Names New Assessment Names Mathematics Lower GradesMath Grades 3–5 Reading Lower GradesReading Grades 3–5 Science Lower GradesScience Grades 3–5 Writing Lower GradesWriting Grades 3–5 MathematicsMath Grades 6–8 Algebra I Algebra II Geometry Reading/LiteratureReading/Lit Grades 6–HS Writing/English CompositionWriting/Eng Comp Gr 6–HS

5. Classroom Diagnostic Tools Two Different Map Configurations There are two different Map Configurations: Lower Grades now named grades 3-5 (response probability.65) Upper Grades now named 6-HS (response probability.5) For CDT testing INSIGHT selects the items by the grade level (determined when student is loaded to eDIRECT) for the first assessment. Exs.: When a session is created for students in grade 4, the user would select content area Math, then assessment name is now Math Grades 3-5. This will ensure the student will get the correct grades 3-5 Map Configuration. Once the student takes the second math assessment it will start the student where they have left off (depending on their ability level). If the student was put into a Math Grades 6-8 assessment, they will not have the ability to see the Grades 3-5 Map Configuration and vice versa.

6. Classroom Diagnostic Tools CDT Correlation Explanation Rich Maraschiello: Pennsylvania Department of Education

7. Classroom Diagnostic Tools Correlations from previous technical reports are shown in the next slide. Please note 1.CDTs in the math content area were first available in 2010-11. 2.CDTs in the reading and science content areas were first available in 2011-12. 3.Keystone Exams were not available in 2011-12 4.Correlations for 2014-15 are not yet available for 2014-15 since the CDT for 2014- 15 just ended a couple of weeks ago. NOTE: Correlations between CDT and Keystone scores are provided in the CDT technical report as evidence of validity (chapter 17). Results from CDT and Keystone are matched using PA secure ID. The correlation reported is the correlation between CDT total scale score and Keystone total scale score.

8. Classroom Diagnostic Tools Correlation between CDT and Keystone Exams Scores CDT Technical Report CDT TestKeystone TestNCorrelation 2010-11Algebra IKeystone Algebra I8,5910.749 2012-13Algebra IKeystone Algebra I94,1380.790 2012-13BiologyKeystone Biology65,9540.795 2012-13Reading/LiteratureKeystone Literature79,1400.757 2013-14Algebra IKeystone Algebra I67,3220.744 2013-14BiologyKeystone Biology58,3010.804 2013-14Reading/LiteratureKeystone Literature56,6590.752 For example, the first row indicates that in the 2010-11 school year there were 8,591 students who took CDT Algebra I and had a Keystone Algebra I scale score. The correlation between CDT scale score and Keystone scale score is 0.749. This positive correlation indicates that students with high CDT total scale score tend to have high Keystone total scale score and vice versa. This is an expected result given that both CDT and Keystone align to the same content standards.

9. Classroom Diagnostic Tools Evaluating CDT Cut Scores The Pennsylvania Department of Education’s (PDE) previously stated goals in evaluating benchmark cuts: Students scoring Below Basic or Basic on PSSA/Keystone are likely to be in the CDT red range, indicating areas of need. Students scoring Proficient or Advanced on PSSA/Keystone are likely to be in the CDT green or blue ranges, indicating strengths to build upon. In balancing over- versus under- identification, it is more desirable to err toward under identification. (Better to have students who are in the CDT red range scoring Proficient or Advanced on PSSA/Keystone than students who are in the CDT green or blue ranges scoring Below Basic or Basic on PSSA/Keystone.)

10. Classroom Diagnostic Tools Reading

11. Classroom Diagnostic Tools Math

12. Classroom Diagnostic Tools New ranges can be found in 2015-16 document on DRC eDIRECT site.

13. Classroom Diagnostic Tools Field Testing Items Additional items have been developed for the CDT to supplement the existing item pools and introduce the evidence based selected response (EBSR) items in the reading content area. Field testing specifics can be found in 2015-16 documents on DRC eDIRECT site.

14. Classroom Diagnostic Tools A New Addition - Batch Printing

15. Classroom Diagnostic Tools Statewide Trainings CDT ToT – 8/12 (IU7), 8/13(IU14), 8/24(IU12) CDT NEXT STEPS ToT – 9/15(Harrisburg), 9/22(Pittsburgh), 10/1(KOP) SAS Institute – Proposed Sessions 12/7 & 12/8

16. Classroom Diagnostic Tools Feedback from the Field How are you supporting data interpretation beyond the training modules? Which leaders in your LEAs could we contact for testimonials on their leadership of using the CDT? Which educators could we contact who are successfully one to one conferencing? Which teachers in your LEAs could we contact about how CDT has impacted their instruction? http://goo.gl/forms/4XzriWmWKn